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CHAPTER I 


INTRODUCTION 


Within the last ten years there has been increasing interest in 
the techniques of rational-emotive therapy as originaliy developed by 
Albert Ellis (1955, 1956, 1957a) and subsequently' supported by an in¬ 
creasing number of other psychotherapists. Although Ellis' position 
developed rather pragmatically, growing out of trial and error modifi¬ 
cations of therapeutic approaches, there was also a simultaneous devel¬ 
opment of an explanatory theoretical system regarding the origins of 
emotional disturbance and maladjustive behavior. Despite acceptance 
and clinical confirmation of the principles upon which rational-emotive 
therapy is based by a number of authors, there has been surprisingly 
little published research of any sort in support of the position out¬ 
side the therapeutic relationship. 

A prominent aspect of Ellis' approach to therapy is the hypoth¬ 
esis that human emotional disorders and maladjustments are a function 
of the extent to which individuals accept and act upon assumptions, 
premises, and ideas that are essentially Irrational in content. lie 
has extracted and extensively uiscussed (1962) at least ten of these 
reliefs which he finds to be common in our culture and highly preva¬ 
lent among neurotics and other disturbed persons. 

One of the basic difficulties and limitations affecting any 
researcn efforts concerning this hypothesis is the present lack of 
objective methods to quantify the relative presence or .fosence of 
ImOoG uGiioxS m u \Ct ivioLia1s • xt crtioicrit uno convenient means ior 
rr.e t -surenrent wv re available, a number of fruitful avenues for research 
into tiiis aypota'fS a s a n o p o s s 11) i c odj octave confirmation o ± it won * v* 


uc u iCiitu. 



Purposes of the Research 


The primary purpose of this research was to validate as measur¬ 
able constructs the ideas Ellis has proposed as irrational beliefs and 
to develop a written instrument sufficiently reliable and valid for re¬ 
search purposes to measure the extent to which persons hold these irra¬ 
tional beliefs. 

A secondary purpose of this research, in the event .the primary 
goal was attained, was to determine the relationship of these irrational 
beliefs to various indices of emotional disturbance and maladjustment 
both as concurrent validation of the instrument and as a-preliminary 
investigation of Ellis' position. 

Rationale and Theory of Rational-Emotive Therapy 

Although a number of books and articles have appeared which pre¬ 
sent various facets of the rational-emotive approach (Ellis, 1955a, 
1955b, 1956a, 1956b, 1956c, 1957a, 1957b, 1958a, 1958b, 1959, 1963a, 
1963b, 1963c, 1964, 1965, 1966, 1967; Ellis § Harper, 1961a, 1961b; 
Ellis, Wolfe $ Moseley, 1966; Ellis § Blum, 1967; Hauck, 1967; Gros- 
sack, 1967) , Ellis has published one book (1962) specifically devoted 
to a full exposition and defense of rational-emotive therapy and its 
underlying theoretical basis. An adequate and thorough understanding 
of this position would require reference to these sources. However, 
the essence of rational-emotive therapy and theory can be stated 
fairly succinctly. 

Many of the principles of rational-emotive therapy are by no 
means new, as Ellis has been quick to point out. In fact, some of 
them were originally stated by ancient Taoist and Buddhist thinkers 
and by early Greek and Roman philosophers. The statements of Epic¬ 
tetus (1S99) in the first century A.D. that "men are disturbed not by 
things, but by the views which they take of them" and of Marcus 
Aurelius (1890) in the same period that "if you are pained by any 
external thing, it is not this thing that disturbs you but your own 
judgment about it" aptly express one of the core concepts of rational- 
emotive theory. 

Ellis contends that the concept of thought aim emotion cis two 
separate and even disparate processes is inaccurate and artificial. 
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In agreement with a number of other recent authors (McGill, 1954; Bous- 
field $ Orbison, 1952; Arnheim, 1958; Rokeach, 1960; Arnold, 1960) he 
argues that the greatest part of what is normally called emotion is 
nothing more than strongly biased, prejudiced, evaluative, or nonra- 
tional thought with natural physiological concomitants. Immediate and 
unreflective emotion, whether positive or negative, is primarily a func 
tion of instinctive tendencies highly controlled or modified by one's 
world view and experiential history. But sustained or reflective emo¬ 
tion is primarily dependent on one's philosophic attitudes•and.thought 
processes. As Branden (1962) points out, "Man's value judgments are 
not innate. Having no innate knowledge of what is true or false, man 
can have no innate knowledge of what is good or evil. His values, and^, 
his emotions, are the product of the conclusions he has drawn or ac¬ 
cepted, that is: of his basic premises." Ellis argues that sustained, 
reflective negative emotions are the essence of what is normally 
called "emotional disturbance" and that they are not only originated 
but sustained by personal philosophies and beliefs which are assumed 
to be true but are in fact irrational and incompatible with adjustive 
behavior.. Inaccurate perceptions and inappropriate behavior result 
from reliance on the beliefs, and the thought patterns and self¬ 
verbalizations built on them augment and nourish unpleasant emotions. 

The unique human attribute of language and the symbol producing 
facility underlying it allow man to be highly rational; to integrate 
experience and anticipate future events in a logical manner (Kelly, 

1955) ; to perceive relationships and to form abstract concepts having 
the quality of reality; and to determine to a large extent his percep¬ 
tions and behavior on the basis of highly personalized and unique con¬ 
structs and thought processes. But this ability is a two edged sword 
that also allows man to define external stimuli as good or bad rather 
independently of the sensate processes; to build construct systems, 
bexiefs, and philosophies that are inconsistent with either reality 
or each other; to protect these internal systems with perceptive pro¬ 
cesses; and to have his perceptions and overt behavior reinforced by 
all kinds of symbolic, nonsensute processes which may have no rela- 
tionsnip to his sensory contact with the external world. 

Ellis therefore states (1962) the central theme of rational 
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emotive therapy as follows: 

• 

...That man is a uniquely rational, as well as a uniquely 
irrational, animal; that his emotional or psychological distur¬ 
bances are largely a result of his thinking illogically or 
irrationally; and that he can rid himself of most of his 
emotional or mental unhappiness, ineffectuality, and distur¬ 
bance if he learns to maximize his rational and minimize his 
irrational thinking. It is the task of the psychotherapist to 
work with individuals who are needlessly unhappy and troubled, 
or who are weighted down with intense anxiety or hostility, 
and to show them (a) that their difficulties largely result 
from distorted perception and illogical thinking, and (b) that 
there is a relatively simple, though work-requiring, method of 
reordering their perceptions and reorganizing their thinking 
so as to remove the basic cause of their difficulties. 

It is my contention, in other words, that all effective 
psychotherapists, whether or not they realize what they are 
doing, teach or induce their patients to reperceive or rethink 
their life events and philosophies and thereby to change their 
unrealistic and illogical thought, emotion, and behavior 
(Ellis, 1959; Stark, 1961). 


Ellis' Irrational Belief System 

As Ellis has repeatedly pointed out, the fact that the family 
and other institutions of a culture directly and indirectly indoctri¬ 
nate individuals with values and beliefs which may be neither consis¬ 
tent nor sensible has been widely recognized for some time. Many 
sociologists and anthropologists have documented this introjection of 
cultural values (Frazer, 1959; lloffer, 1951, 1955; Rokeach, 1960; 
Rosenfeld, 1962; Tabori, 1959, 1961), and this source of individual 
values and beliefs is now widely recognized. For example, Cuber, 
Harper, and Kenkel (1956) discuss "the older nonrational acceptance 
of value positions" in American society and point out that many of 
our most cherished and dogmatically upheld values are only assumed to 
be "good" values and are rarely reviewed or questioned. La Barre 
(1955) indicates that in our society "a child perforce becomes a Right 
Thinker before he learns to think at all." 

Neo-Freudian psychoanalytic authorities have been distinguished 
by their increasing emphasis on culturally induced beliefs and values 
as a source of human disturbance. Horney (1959), Fromm (1941, 1947, 
1955), Reich (1949) , and a number of others have been concerned with 
illogical social teachings as a primary source of neurosis. 
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Through his therapeutic relationships and in the course of the 

m 

development of rational-emotive theory, Ellis has noted and abstracted 
a number of beliefs or philosophies which he finds to be highly promi¬ 
nent in the thought processes of emotionally disturbed and maladjusted 
people, lie considers these beliefs to be basically irrational in nature 
and content and to be supportive or neurosis and disturbance. In his 
text on rational-emotive therapy, Ellis (1962) discusses fully both the 
irrational elements in these ideas and the alternatives to these philo¬ 
sophies which would be conducive to mental health. The following list¬ 
ing provides the beliefs as set forth by Ellis with a brief summary of 
only the major elements of irrationality involved. 

Irrational Belief 1 

The idea that it is a dire necessity for an adult human being 
to be loved and approved by virtually every significant other 
person in his community. 

The essence of this belief is that love and approval are needs 
or necessities rather than desirable conditions. A demand that one 
must be approved by others sets a perfectionistic, unobtainable goal. 
Even if one could win approval from all important others, he would 
still tend to worry about the degree of approval or the maintenance of 
it. As Loevenger (1962) and Stewart (1962) have observed, a dire need 
to be loved is nearly always accompanied by high anxiety. 

If one is always to be loved, one always has to be lovable, and 
this sets up an impossible goal for oneself. Inordinate regard for the 
approval of others requires giving up one's own wants and preferences 
and therefore negates self-directing behavior. Overconcern with being 
loved inhibits and almost bars the creative, self-actualizing involve¬ 
ment in loving others. 

Irrational Belief 2 

The idea that one should be thoroughly competent, adequate, and 
achieving in all possible respects if one is to consider oneself 
worthwhile. 

Again this belief involves the substitution of a demand for a 
more rational desire. Linkage of one's self-worth to overly high ex¬ 
pectations for oneself leaves the way open for anxiety and feelings or 
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personal worthlessness. A person who feels he must achieve invariably 
compares himself to others and becomes other-directed rather than self- 
directed. Placing great emphasis on achievement confuses one's extrin¬ 
sic value (the value that other people place on one's performance or 
characteristics) with one's intrinsic value (one's aliveness or one's 
value to oneself)(Hartman, 1959). Overconcern with achievement usually 
results in increased fear of taking chances, making mistakes, and of 
failing at certain tasks; this in turn tends to sabotage the very 
achievement for which one is striving. 

Irrational Belief 5 

The idea that certain people are bad, wicked, or villainous and 
that they should be severely blamed and punished for their villainy. 

This belief implies absolute standards of truth or goodness 
which are in fact purely definitional and without scientific founda¬ 
tion. Also implied is a degree of free will and choice of conduct 
which is inconsistent with present knowledge of the various determi¬ 
nants of behavior. Although people should of course accept responsi- ' 
bility for what may generally be considered "wrong" or "immoral" 
behavior, this does not mean they should be blamed or condemned by 
either themselves or others for their ignorance, stupidity, or dis¬ 
turbance. Blame tears down human worth and is functionally inopera¬ 
tive because it does nothing to help the person improve. Blaming 
results in hostility and anger which are basic causes of much human 
disturbance (Chambers 5 Lieberman, 1962). Invariably one who blames 
others will also blame himself, and hostility and anger toward one¬ 
self greatly inhibit the rational goals of acceptance of one's fal¬ 
libility together with the determination of ways to improve one's 
behavior. 

Irrational Belief 4 

The idea that it is awful and catastrophic when things are 
not the way one would very much like them to be. 

This belief allows people to utilize frustrating circumstances 
to maintain emotional disturbance. It is perfectly reasonable to dis¬ 
like undesirable situations; but tne belief that things shouiu be 
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different because one desires them that way is highly irrational. The 
rational approach to frustration is to try to change unpleasant circum¬ 
stances if possible but then accept them philosophically if they cannot 
be changed. Any sustained negative emotion over such circumstances 
helps attain neither goal. 

Although there is much evidence supporting the hypothesis that 
frustration leads to aggression (Dollard, Doob, Miller, Mowrer, 6 Sears, 
1939; Doliard 6 Miller, 1950), it is probable that in humans it is not 
really the frustration itself, but the subjective attitude'toward and 
perception of the frustration that really causes hostility and aggres¬ 
sion, as indicated by Pastore (1950, 1952) and Arnold (1960). Melzack 
(1961) and others have similarly shown that even physical pain is ex¬ 
perienced and reacted to primarily as a function of the subjective, 
attitudinal set of the individual rather than the intensity of the 
painful stimulus. Therefore rationally no amount of frustration or 
deprivation need make a person unhappy if he does not define his pre¬ 
ferences as a dire necessity. 

Irrational Belief 5 

The idea that human unhappiness is externally caused and that 
people have little or no ability to control their sorrows and 
disturbances. 

As previously pointed out, people are disturbed not by exter¬ 
nal events but by their interpretation of those events. This belief 
makes it possible for one to abdicate responsibility for one's emo¬ 
tions and to project that responsibility to other people or to the 
environment. Although it may be difficult for people to control de¬ 
pression, unhappiness, and other negative emotional states, particu¬ 
larly if they have had little practice at doing this, it is certainly 
not impossible. If instead of saying, "this situation makes me un¬ 
happy," a person could more rationally say, "I am making myself un¬ 
happy by what I am telling myself about this situation," then this 
irrational belief could not be maintained. 


Irrational Relief 6 


lC ide; 


hat l 


some i 


thing is or may be dangerous or fearso; 
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one should be terribly'concerned about it and should keep 
dwelling on the possibility of its occurring. 

Although it is wise to consider dangerous possibilities and to 
plan to avert them or minimize their consequences should they occur, 
this is the type of objective, rational thought which has nothing in 
common with anxiety, worry, and unrealistic fear, all of which are 
basically irrational and maladaptive. Overconcern about possible fu¬ 
ture events usually is self-intensifying since it leads to exaggeration 
of the chances for occurrence of the dreaded event. It sufficiently • 
inhibits calm rational thought to the extent that one is less able to 
meet dangers effectively when they do occur and one finds it difficult 
to properly evaluate dangers. Many of the dreaded events which people 
worry about are inevitable or entirely out of the control of the per¬ 
son involved, so that worry has only the negative results of making 
life less enjoyable until or if the events do occur. 

Irrational Belief 7 

The idea that it is easier to avoid than to face certain 
life difficulties and self-responsibilities. 

This idea considers the ease of avoidance at the time of deci¬ 
sion but ignores the many problems and annoyances caused by avoidance. 

In essence this irrational belief emphasizes the immature approach to 
problems, placing greater emphasis on the pleasure or the pain of the 
moment without regard to the long term benefits to be obtained from 
meeting the challenges of life in a commitment to long term goals. 

Irrational Belief 8 

The idea that one should be dependent on others and needs 
someone stronger than oneself on whom to rely. 

Although in our society there is a necessary amount of depen¬ 
dence and cooperation with others, there are a number of reasons not 
to overemphasize dependence. The more one relies on others, the more 
he finds it necessary to give up his own goals and desires in life. 

The more one relies on others for guidance and assistance, the less 
he tends to do for himself and the more he tends to lack basic self- 
confidence and security. By depending on others one puts himself 
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needlessly at the mercy of outside forces which he cannot possibly con¬ 
trol; and if the sources of security that he creates are eliminated for 
any reason, he is subject to severe problems through his being unpre¬ 
pared and unable to handle his own life. 

Irrational Belief 9 

The idea that one's past history is an all important determiner 
of one's present behavior and that because something once strongly 
affected one's life, it should indefinitely have similar effect. 

This irrational belief also involves denial of responsibility 
for one's behavior. Although it is very true that as a result of the 
past one may find it very difficult to change in some ways, it is 
highly irrational to believe that it is impossible for change to occur. 
Reliance on this philosophy makes it much more difficult to meet pro¬ 
blems efficiently as they arise. It provides a powerful excuse to 
avoid self-improvement and to drift along in a self-indulgent, problem- 
avoidant way of life which often leads to emotional disturbance and 
maladjustment. 

Irrational Belief 10 

The idea that there is invariably a right, precise, and perfect 
solution to human problems and that it is catastrophic if this 
perfect solution is not found. 

Although it is sensible and wise to want to achieve the most 
practical and feasible solution to one's problems, it is highly unreal¬ 
istic and irrational to expect there will always be a perfect solution 
available. This belief involves a desire for certainty in everything, 
and as Reichenbach (1953) and others have shown, we live in a world of 
probability and chance with nothing certain. Perfectionism is not 
only irrational, it is also impractical in that it normally limits 
possible solutions to problems. Not only are satisfactory solutions 
harder to obtain, it is much more difficult for the perfectionistic 
person to reach any solution since he normally feels he must consider 
every possible side of every possible alternative. 
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Other Measurement Efforts Reported 

At the time this research was initiated, there was no report in 
the literature of other efforts to measure the system of irrational 
beliefs which is the subject of this study. However, two pertinent 
articles have appeared since that time. 

Hartman (1968) has reported on the construction of a self- 
administering, objectively scored, diagnostic instrument for use in 
assessing specific levels of irrational thinking. He assembled an 
original pool of 135 items related to prevalent irrational ideas. On 
the basis of item-total correlations in an administration to more than 
500 college students, 60 items were retained to comprise his Personal 
Beliefs Inventory. Scoring for each item is on a six point disagree- 4 
agree scale. No subscores are calculated for specific beliefs; the 
test yields only a total score ranging from 0 to 300. Reliability 
coefficients were obtained from a sample of 30 college students and 
another sample of 85 college students. Respectively, test-retest 
stability coefficients were .89 and .91 while split-half reliability 
using the Spearman-Brown formula were .95 and .90. No formal valida¬ 
tion studies were reported, although two studies are cited which would 
strongly imply that formal validation procedures would be successful. 

In one case 8 individuals undergoing individual rational-emotive psy¬ 
chotherapy showed a drop in mean scores from 236 to 121 after ten 
sessions. In the other example 23 students in a psychopathology class 
had a change in mean scores from 165 to 91 between pretest and post¬ 
test. 

Argabrite and Nidorf (1968) have reported a measure largely 
utilizing the irrational ideas described by Ellis. In format this 
test consists of 15 five point scales anchored at one end with a self- 
report description of an irrational belief and anchored at the other 
end with a description of the antithetical rational idea. For the 
most part the measure retains the exact language of Ellis as well as 
the paraphrasings of Lynn (1966) and Gullo (1966), who restated some 
of Ellis' descriptions. Two items were added to cover additional ir¬ 
rational beliefs contributed by the authors. Subjects were asked to 
select the scale position most representative of them in their per- 

This measure was administered to 204 students in an 


sonai beliefs. 
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introductory psychology class. The only test statistics reported are 
a standard dispersion for total score and class means for both total 
score and individual items. Although a qualitative report was given 
that the test tends to correlate positively with other, more tradi¬ 
tional tests of psychopathology without the correlations being parti¬ 
cularly high, no data is presented supporting this statement. 

Personality Factors as Indices of Psychopathology 

Perhaps the best known empirical system of personality study and 
description at the present time is that based primarily on the work of 
Raymond B. Cattell, Ph.D-, D.Sc., Research Professor of Psychology at 
the University of Illinois. Cattell's reputation in the areas of psy¬ 
chometrics and factor analytic investigation of personality and motiva¬ 
tion has become well established over 35 active research years. He 
has published some 20 books in the field of psychology, well over 200 
professional articles, and some 25 psychological tests. 

Cattell has described the procedures and results of his research 
into the structure of personality in both detailed (1946, 1957) and 
simplified (1965) books and any number of articles. In brief, it may 
be said that through repeated factor analytic studies of the results 
of innumerable behavioral ratings and observations, objective testing 
of many types including cognitive and physiological tasks, and self- 
report questionnaire items, a number of consistent, distinct, measur¬ 
able personality source traits have been identified. A number of in¬ 
struments have been constructed to measure these specific factors in 
personality, but by far the most widely known and used in both re¬ 
search and applied settings have been those of the questionnaire type. 
Among these are the 16PF (Cattell 5 Eber, 1961), the HSPQ (Cattell h 
Beloff, 1965), the NSQ (Scheier h Cattell, 1961) and the IPAT Anxiety 
Scale (Cattell $ Scheier, 1965), offering measures of from five to 
sixteen primary factors. 

Since these source traits are based on oblique factors and are 
intercorrelated to some extent, although not highly so, it is possible 
to factor analyte scores on all sixteen of them arid secure second- 
order factors more descriptive of broad spectrums of behavior. Of the 
fcur prominent second-order factors appearing, the one which has no 
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doubt received most attention in both research and clinical use is that 
of anxiety, which is loaded by factors C-, H-, L+, 0+, Q3-, and Q4+. 

The anxiety factor resulting from these primary factors has now been 
solidly confirmed as to structure in some 20 separate studies, the most 
recent of note being by Cattell (1965b), Karson (1961), Horn (1963), 
and Mitchell (1963). It can be computed by specification equation di¬ 
rectly from the scores on its components; or the IPAT Anxiety Scale, 
which measures only these traits in a weighted manner, can be used to 
provide a direct score. 

Kear-Colwel1's (1965) study showed a correlation of +.76 for the 
anxiety factor and neuroticism as defined by Eysenck (1953) and measured 
by the Maudsley Personality Inventory. Karson (1958) reaches the con- 
elusion ". . .that the K, F, and L scales of the MMPI all appear to be 
measuring the second-order questionnaire factor of anxiety." Kahn et 
al . (1964) factor analyzed items from the MMPI, CPI, Cornell Medical 
Index, and Bernreuter Personality Inventory, along with the IPAT An¬ 
xiety Scale and the 16PF. The top loading on the simple structure fac¬ 
tor identified as anxiety was +.90, achieved by the IPAT Anxiety Scale 
total score. Loadings from other scales varied from +.43 to +.73. 

A number of studies have shown a high relationship between 
scores on the anxiety factor and various psychiatric symptoms, follow¬ 
ing the lead of Scheier et al. (1961, 1962). For example, Cattell and 
Rickels(1964) studied clinical symptoms in relation to the anxiety 
factor. They found that psychiatric evaluations of irritability, 
anxiety, depression, and phobic behavior loaded +.42, +.33, +.32, and 
+.22 respectively on the anxiety factor despite well known limitations 
in validity and inter-rater reliability in clinical judgments. These 
same studies, however, showed that somatization and hypochondria did 
not load on the anxiety factor, illustrating that even though anxiety 
as defined by the factor may predict much of neurotic or disturbed 
behavior, it is not the only element doing so. 

The increasing number of studies relating the anxiety factor 
defined by the six primary traits or factors to various indices of 
maladjustment and emotional disturbance are well cited in Cattell and 
Scheier (1961, 1963) and more recently by the continuing IPAT Infor¬ 
mation Bulletin Series. 


In general the studies confirm the b.isic 
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position of anxiety as an inverse function of mental health and adjust 
ment. It seems to be a common element in otherwise different person¬ 
alities which is characteristic of a wide variety of clinical groups. 
Not only are nearly all nonpsychotic clinical groups highly discrimi¬ 
nated from normals by the primary factors contributing to anxiety, but 
Court (1965) has even found acute schizophrenics to suffer from a very 
high anxiety level. 

The literature therefore supports the use of anxiety and the 
primary personality factors comprising it as adequate and valid in¬ 
dices of general maladjustment and emotional disorder, with the added 
advantages of the indices being obtainable in a single administration 
with one instrument. 

Admitted Symptomology as Indices of Psychopathology 

The quickest and most common clinical method of determining the 
extent of maladjustment and emotional disturbance is to inquire into 
a number of complaint areas common to those who are having problems. 

If the person answers truthfully, this procedure provides the most 
direct measure of the subjective experience of negative emotion and 
the overall difficulty the person is having in coping with life's pro¬ 
blems. An important question, however, is whether or not the person 
who has problems will answer truthfully and admit them instead of 
following social desirability bias (Edwards, 1953, 1957). Of course, 
some persons will not, but in general as Peterson (1965) has shown, 
social desirability bias is a function of perceived adjustment. As 
has been illustrated in a number of studies (Bendig, 1959; Cattell 
Scheier, 1958, 1961; Couch d Kenniston, 1960), the willingness to 
admit defects in oneself tends to be an intrinsic part of the anxiety- 
maladjustment syndrome. Even though Sweney and Rich (1968a, 1968b) 
found that response bias extremely affected MMPI scores as well as 
16PF scores to a lesser extent, the response style was determined to 
be a measure of anxiety; and the same phenomenon is probably operant 
in direct questions concerning symptoms. Therefore the admission of 
psychiatric symptomology should be an excellent index for actual 
psychopathology. 
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Common Demographic Variables and Psychopathology 

It is generally considered that the more common types of emo¬ 
tional disorder and maladjustment are most severe at early ages, tend¬ 
ing to decrease somewhat with increased maturity and experience in 
life (Coleman, 1964). Bahn et al. (1961) found psychoneurotic dis¬ 
orders to be more common in early adulthood than during any other life 
period. Cattell (1965a) states that anxiety is found to be high in 
adolescence, gradually declining as the individual settles his pro¬ 
blems of occupational adjustment, marriage, and social setting. 

Bahn et al. (1961) also found psychoneurotic disorders to be 
more frequent among females than among males. Results from many 
sources confirm that females have a significantly higher level of 
anxiety than males (Bendig, 1960; Burnett § Thompson, 1963; Taylor, 
1966; Wheeler, 1965). These findings substantiate typical clinical 
experience where substantially more females than males appear at 
outpatient facilities for treatment. 

Hardt and Feinhandler (1961) and Jaco (1960) state that in 
general the range of educational background is the same for psycho¬ 
tic patients as for the general population. Coleman (1964) remarks 
that psychoneurotic disorders are common in all educational and 
socio-economic backgrounds as well as all educational levels. How¬ 
ever, he does not substantiate this opinion, and there is strong 
reason to believe from a logical viewpoint that the incidence of at 
least nonpsychotic disturbance would have some inverse relationship 
to education. The general positive relationship between intelligence 
and education attained is intensified by the fact that most common 
measures of the former incorporate knowledge and achievement tests, 
particularly when the measure is written, as Cattell has pointed out 
(1965a). Despite Coleman's statement above, the studies of Terman 
(1940), Juda (1949), Terman and Oden (1959) and MacKinnon (1962) all 
emphasize a negative relationship between mental disturbance or ir¬ 
rationality and intellectual capacity. Wechsler's (1956) operational 
definition of intelligence as "the aggregate or global capacity of 
an individual to act purposefully, to think rationally, and to deal 
effectively with his environment" incorporates a defined inverse re¬ 
lationship with maladjustment which should hold for education also. 


CHAPTER II 


METHODS AND PROCEDURES 


Plan of the Research 

The plan of the research involved the following steps or phases: 
Basic Decisions 

Decisions were made involving test design and format, procedures, 
selection of criterion instruments, statistical methods to be employed, 
sample characteristics, research hypotheses, etc. in consideration of 
the research goals. The results of these decisions are incorporated 
into the discussions which follow. 

Test Construction 

Involved in this phase were item writing, item selection, and 
initial construct validation. 


Test Investigation 


This phase involved investigation of the various descriptive 
test statistics, cross validation of the test as a measure of the con¬ 
structs involved, concurrent validation of the test in terms of its 
relationship to various criteria, and determination of the relationship 
between test scores and common demographic variables. 


;arch 


)Otheses 


As a means of structuring both the accumulation of data and its 
statistical analysis and to provide an a priori basis for decisions 
regarding significance of results, the following research hypotheses 
were formulated: 
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As determined by factor analysis, the irrational beliefs enun¬ 
ciated by Ellis are sufficiently distinct in content and stable in 
structure to be measurable as separate constructs defined by factors 
which can be replicated in a separate nonhomogenous population. 


Research 


>othesis 


As determined by loadings of scale items on factors defining 
the scales, construct validity of Irrational Belief Test (IBT) scales 
will exceed a minimum acceptable value of .40. 



The IBT will have sufficient homogeniety within scales to pro¬ 
vide a minimum acceptable internal consistency reliability of .50 in 
any scale and a mean reliability of .60 for all scales. 



The reliability of measurement in the IBT and the stability of 
the domain will be sufficient to provide a test-retest correlation 
between scores over a 24 hour period of not less than .60 for any 
scale and not less than a mean of .75 for all scales. 



There will be a significant positive functional relationship 
between irrational beliefs as measured by the IBT and self-report of 
maladjustment symptoms. 



There will be a significant positive functional relationship 
between irrational beliefs as measured by the IBT and scales C-, 1 i-, 
j O^, Q5- , and Q -t or tne ± 6 ? r . 

Researcn hypothesis 7 

1 1 1ero will be no significant x u .< cionai re i. a <. ioasnip between 
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irrational beliefs as measured by the 1BT and scales A, E, F, G, I, M, 
N, Ql, and Q2 of the 16PF. 

Research Hypothesis 8 

There will be a significant negative functional relationship be 
tween irrational beliefs as measured by the IBT and intelligence as 
measured by scale B of the 16PF. 

Research Hypothesis 9 

The IBT will be a sufficient discriminator of mental distur¬ 
bance that patients in a mental hospital will attain significantly 
higher scores than will subjects from a general adult population. 

Research Hypothesis 10 

There will be a significant negative functional relationship 
between irrational beliefs as measured by the IBT and age of the sub¬ 
jects . 

Research Hypothesis 11 

Females will score significantly higher in irrational beliefs 
as measured by the IBT than will males. 

Research Hypothesis 12 

There will be a significant negative functional relationship 
between irrational beliefs as measured by the IBT and education level 
of the subj ects. 


Subj ects 

Group A was the sample used in initial item selection and con¬ 
struct validation of the instrument. It consisted of 151 junior and 
senior students in advanced undergraduate courses in psychology at 
the iexas Technological College, Lubbock, Texas. Despite the impli¬ 
cations of the name, this is a multiple school major university with 
over 19,000 students. The students were therefore representative of 
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the diversified backgrounds and interests found in such an academic 
climate. The sample was approximately 60% female. Most ages were in 
the early twenties. 

Group B was the larger heterogeneous sample used for cross vali¬ 
dating factor structure, in determining descriptive statistics on the 
instrument, in establishing concurrent validity against external cri¬ 
teria, and in analyzing the effect of concomitant variables. Total 
sample size was 427 subjects. The sources and selection of subjects 
was multiply determined by the need for a sufficiently large sample, 
heterogeniety with respect to major demographic variables', and maxi¬ 
mum variance with respect to emotional disorder and maladjustment. In 
the sample were 105 junior college students; 73 senior students at the 
Texas Technological College (none from group A); 72 patients at a men¬ 
tal hospital; and 177 volunteers from a general adult population. 

The 105 junior college subjects were students at South Plains 
College, Levelland, Texas. This is a relatively smaller school in a 
smaller city as compared to Texas Technological College, and it was 
felt that dividing the student portion of the total sample between the 
two schools would tend to insure more heterogeniety in a number of 
respects. 

The hospital sample was secured at Big Spring State Hospital, 

Big Spring, Texas. Included in the sample were 24 alcoholics, 13 chro¬ 
nic schizophrenics in an intensive rehabilitation program, 15 mixed 
diagnoses involving chronicity, and 20 mixed new admissions with acute 
symptomology. Except for the alcoholics, all were receiving medica¬ 
tion for symptom control. All age groups were represented in the 
sample, but there was some probable bias toward lower educational and 
socio-economic levels. 

The volunteers in the general adult sample were solicited and 
secured from a variety of sources. Occupations represented included 
school teachers, route salesmen, nurses, secretaries, business execu¬ 
tives, USAF personnel, outside salesmen, and housewives. Ages ranged 
from 18 to 60, with the majority of subjects being in the 25 to 40 
year age range. 



19 

Variables 


The Research Instrument 

The instrument constructed and investigated in this study was 
called the Irrational Beliefs Test or, for brevity, the IBT. The test 
format used was that of the typical self-report attitude or value scale. 
The entire instrument was a combination of ten separate scales, each 
measuring a specific irrational belief as discussed by Ellis. Each 
item presented a statement with which subjects were asked to disagree 
or agree. Scaling was on the Likert (1932) model with summative sco¬ 
ring over a five position response scale for each item. The IBT thus 

« 

provided both individual scale scores and a total score summing all 
scales. 

For utility in administration, scoring, and processing of data, 
the instrument was presented to subjects in the form of a reusable 
test folder with a separate answer sheet. A reproduction of the test 
may be seen in the Appendix. Answer sheets were standard forms used 
for IBM Optical Scanner machine scoring. 

Factor analysis was one of the methods used for test validation, 
including as variables not only the test items but criterion variables 
as well. In view of the 135 maximum variable limitation in the factor 
analysis programs available at the computer center used in the study, 
it was decided to limit item count for the IBT to 100 providing suffi¬ 
cient reliability could be obtained. In addition, it was felt that a 
100 item test answered on a 5 position scale would involve a testing 
time of approximately twenty minutes, fitting well the criterion of 
utility. 

For ease in both hand and computer scoring, items were arranged 
in rotating order by scales so that the last digit of each item number 
would correspond to the scale and irrational belief involved. Despite 
this identification of scale by item number, a key is necessary for 
scoring since both direct and reverse scored items were used and ran¬ 
domly arranged. 

This instrument furnished a total of 111 variables used in the 
research. Included were 10 item scores for each scale, a summated 
score for each scale, and a total score summing all item scores. 
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The Sixteen Personality Factor Questionnaire 

The established psychological instrument chosen to furnish cri¬ 
terion variables for this study was the Sixteen Personality Factor 
Questionnaire by Cattell and Eber (1961), more often called the 16PF. 
This test furnishes scores on each of sixteen separate personality 
factors and is the leading instrument produced by the research efforts 
of Cattell and others in the investigation of personality through fac¬ 
tor analysis, as previously discussed. The personality dimensions 
measured by the test are bipolar source traits that have been described 
both by technical titles and by lists of adjectives which’correlate 
highly with the trait factors. Full discussions of the nature of these 
traits and their origins are found in a number of texts (Cattell, 1946, 
1950, 1957; Hall $ Lindzey, 1957; McClelland, 1951). Adjectival des¬ 
criptions of the primary factors measured by the 16PF are shown in 
Table 1 on the next page. 

The full background of the 16PF is documented in four books and 
over 100 journal articles as referenced in the Handbook (Cattell 5 
Eber, 1962). In the oldest and most popular forms (A £, 13), split-half 
reliabilities for each of the scales range from .71 to .93, averaging 
about .83 or .84. Internal construct validities have been estimated 
for each of the scales from known factor loadings of test items on the 
factors and also separately from the correlation of two factor halves 
(A and B forms together). The resulting estimates range from .75 to 
.96, averaging approximately .88. Coefficients for each form sepa¬ 
rately are lower in accordance with the standard formulas involving 
test length. 

All forms of the 16PF are presented in test booklets which may 
be used with separate answer sheets and administered either to groups 
or individuals. Form A, which was used in this study, consists of 187 
items which are intelligible to a wide range of educational levels and 
suitable for all adult ages. Minimum limits are usually considered to 
be a sixth grade reading level and ages 15 to 16. 

Since in the study it was uesired to investigate the research 
instrument with respect to both personality and maladjustment variables, 
use of the 16PF as a criterion instrument offered a number of advan- 
U'ith any instrument measuring specific factors in behavior, 


t ages . 
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TABLE 1 

ADJECTIVAL DESCRIPTION OF 16PF SOURCE TRAITS 


Factor Low (-) score descriptions High (+) score descriptions 


A 

B 

C 

E 

F 

G 

H 

I 

L 


M 


N 

0 

Qi 

Q2 

Q3 


Q4 


Reserved, detached, critical, 
cool 

Less intelligent, concrete¬ 
thinking 

Affected by feelings, easily 
upset, emotionally labile 

Humble, mild, obedient, con¬ 
forming 

GSober, prudent, serious, ta¬ 
citurn 

Expedient, makes own rules, 
by-passes obligations 

Shy, restrained, diffident, 
timid 

Tough-minded, realistic, 
self-reliant, no-nonsense 

Trusting, adaptable, free of 
j ealousy, 

Practical, externally orien¬ 
ted, careful, conventional 

Forthright, natural, art¬ 
less, sentimental 

Placid, self-assured, serene, 
confident 

Conservative, respecting es¬ 
tablished ideas, tolerant 

Group dependent, a "joiner" 
and good follower 

Casual, impulsive, careless 
of protocol, untidy 

Relaxed, tranquil, torpid, 
uhfrustrated 


Outgoing, warmhearted, easy¬ 
going, participating 

More intelligent, bright, 
abstract-thinking 

Emotionally stable, reality 
facing, maturely calm 

Assertive, aggressive, in¬ 
dependent, stubborn 

Happy-go-lucky, heedless, 
gay, enthusiastic 

Conscientious, persevering, 
staid,\rule-bound 

Venturesome, socially bold, 
uninhibited, spontaneous 

Tender-minded, dependent, 
over-protected, sensitive 

Suspicious, self-opinion¬ 
ated, hard to fool 

Imaginative, internally 
oriented, impractical 

Shrewd, calculating, pene¬ 
trating, worldly 

Apprehensive, depressive, 
worrying, troubled 

Experimenting, liberal, 
critical, free-thinking 

Self-sufficient, prefers 
own decisions 

Controlled, compulsive, 
self-disciplined 

Tense, driven, overwrought, 
fretful 
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it is difficult to adequately explain or predict on the basis of any 
one factor. With the 16PF a number of traits contributing to variance 
in personality can be assessed at the same time, with the interrela¬ 
tionships between them and the multiple determinants of behavior being 
more adequately taken into account in any explanatory or predictive 
endeavor. The efficacy of this approach is seen in the increasing 
number of studies appearing in the IPAT Bulletins distributed by the 
16PF publisher and elsewhere showing multiple correlations of 16PF 
factors with specific life criteria ranging from .50 to as -high as .88. 
These criteria cover such diverse areas as school achievement, response 
to therapy, and earnings in salesmanship. The use of this instrument 
as a criterion measure in the present study therefore enhanced the 
possibility of useful, explanatory data being obtained. 

Another advantage of the 16PF as a criterion instrument con¬ 
cerned the use of specific scores as indices of emotional disorder or 
maladjustment. As previously discussed, six of the primary factors 
and the second-order factor they contribute to have been shown to be 
excellent indices in this clinical area. Although the IPAT Anxiety 
Scale would have involved less testing time and could have furnished 
a direct measure of the second-order factor, the full 16PF was used 
for the following reasons: (1) The Anxiety Scale would not have pro¬ 
vided measures of the other personality traits desired as criteria. 

(2) Its primary factor scales vary in length to provide weighted sum- 
mated scoring for the anxiety factor, and as a result some of them 
are less reliable than 16PF scales on the same traits. (5) It was 
desirable to use the component primary traits as criteria rather than 
the more global measure since it was possible that irrational beliefs 
would be a function of some of them but not all, and comparitive 
relationships were of interest. 

Self-Report of Maladjustment Symptoms 

In addition to 16PF factors, it was decided to include as 
criteria the degree of maladjustment perceived in themselves by the 
subjects of the study. A brief 25 item instrument was devised to 
measure the relative presence or absence of common arid ordinary psy¬ 
chiatric complaints. This instrument as administered is shown in the 
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Appendix. The items are simple statements such as "I worry". The sub¬ 
jects responded on a five point scale ranging from "almost never" to 
"most of the time." Twenty-five additional criteria of symptomology 
were therefore provided, in addition to a total score incorporating 
variance on all the symptoms. 

The use of such an instrument as a criterion measure in the re¬ 
search was justified on several counts. The items offer a direct and 
rather parallel measure of the same types of complaints offered by 
those who come into a clinical situation for counseling or therapy. 

The scale was not a psychological test in the usual sense but rather 
a direct questioning device with a response format allowing objective 
scoring. 

In addition it was felt that any distortion in responses would 
intensify desired information instead of minimizing it. As previously 
discussed, perceived maladjustment and anxiety are a direct function 
of the willingness to admit weaknesses and problems. Therefore the 
use of scores on this instrument as criteria for emotional distress 
would not be hampered to any great extent by the normal problems of 
response bias. 

Demographic Variables 

Since it was desired to consider the relationship of basic demo¬ 
graphic variables to the incidence of irrational beliefs as measured 
by the IBT and since information as to age, sex, and education level 
was readily available from the subjects, these variables were included 
in the study. 

Due to the necessity of handling data input for the study with 
an IBM Optical Scanner with five position scales, it was necessary to 
break age and educational level data arbitrarily into classificatory 
data. Since sex exists as a dichotomous variable, the recording of 
this information on the answer sheets was no problem. For education 
level, the five classifications used were as follows: (1) did not com¬ 
plete ninth grade; (2) did not complete high school; [5) did not finish 
two years of college; (4) did not complete college; (5) college graduate 
or above. Subjects were assigned to the highest level possible. For 
age, the following classifications were used: (1) ages 21 and below; 
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(2) ages 22 to 30; (3) ages 30 to 40; (4) ages 40 to 50; (5) ages 50 
and over. 


Procedures 


Administration of Instruments 

Except for the general adult volunteers in Group B, all testing 
was by group administration with supervision. Group A accomplished 
the preliminary 200 item IBT only. All subjects in Group B were ad- 
ministerd the final 100 item IBT, the Form A 16PF, and the Symptom 
Measure. Adult volunteer subjects were given individual packets con¬ 
taining the three test instruments, the answer sheets, and standard 
instructions. Test packets were usually returned with two or three 
days, and in the majority of cases it is probable that very little 
time lapsed between accomplishment of the several tests. All subjects 
were given or instructed to take the Symptom Measure as the final 
instrument so that its more obvious clinical nature would not bias 
IBT and 16PF responses . 

Processing of Data 

All data processing and statistical analyses were done using 
the facilities of the Computer Center at the Texas Technological Col¬ 
lege. At the time of the study the equipment available included an 
IBM 1401 Computer with an Optical Scanner as one accessory and an IBM 
7040 Computer on which all statistical work was done. 

Answer sheets for all groups were processed through the Opti¬ 
cal Scanner with direct card output. Cards were sequence punched to 
allow ready identification and prevent possible mishandling errors. 

All data was then read onto tape for storage and processing through 
the reversal and scoring programs. Both the answer sheets and the 
original card decks were retained and stored for future referer.ee if 
necessary. 

A special computer program was written to reverse IBT scores 
of both groups so that signs in statistical results such as correla¬ 
tion matrices would be consistent and meaningful without reference 
back to item content. Special programs were then written and used to 
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secure both scale scores and total score for the IBT, scale scores for 
the 16PF, and total score for the Symptom Measure. Tape output from 
the scoring program for Group A provided 200 item scores, 10 scale 
scores, and a total score for the preliminary IBT. Tape output from 
the scoring program for Group B provided 100 IBT item scores, 10 IBT 
scale scores, an JBT total score, 25 symptom item scores, a total symp¬ 
tom score, 16 scale scores from the 16PF, and values representing age, 
sex, and education level. This data was then transferred to punched 
cards for the routine statistical processing, and the tapes were re¬ 
tained for reference in case of damage to the card decks. 

The statistical analysis of the data was done using standard 
programs which were a part of the Computer Center Statistical Library. 
Product-moment correlations and descriptive statistics were secured 
both by direct program and as part of the output from other programs 
such as that for factor analysis. All factor analysis was done with 
the Burdsal Factor Analysis Program TTS001, which extracts factors 
according to a number of criteria by the principal axes method and 
provides both orthogonal and oblique rotation by the varimax and pro¬ 
max methods respectively. Stepwise regressions and t-tests for diffe¬ 
rences between groups were done with standard programs of the Biomed 
group originally secured from the Health Sciences Computing -Facility 
of the School of Medicine, lJniv< , s i ty of California, Los Angeles. 


Test Construction 


All initial items were written by the author with the goal that 
they should reflect relative presence or absence of the appropriate 
irrational belief in Ellis' system. Forty items were written for each 
belief, twenty of them as direct measures and twenty as inverse mea¬ 
sures . 


In line with the sugg.es 
to select 200 items for initia 
statistical relationships for 
necessary therefore to discard 
the twenty best items on each 
method chosen for this stare 1 o 
validation based on content in 


tions of Guilford (1954), it was decide^ 
1 administration in order to utilize the 
final selection to 100 items. It was 
one hi a 1 f the written items, retaining 
scale for initial administration. The 
f item seleetioe. was that of consensual 
rough the use of judges. The author 
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acted as one of the judges, with another being a college graduate naive 
in psychometrics and psychology in general and the third being a Ph.D. 
psychologist with major interests in psychometrics and considerable 
test writing experience. Each judge was required to read Ellis' (1962) 
discussion of each irrational idea immediately prior to selection of 
items for each scale. Each judge selected the twenty items for each 
scale that he felt would most accurately describe and measure attitudes 
inherent in the espousal of the irrational belief. On most scales 10 
to 15 of the items were selected by all three judges, and these items 
were all included in the final selection. In no instance.was an item 
included in the final twenty that had not been chosen by at least two 
judges. In event of ties, selections involving the naive judge were 
discarded in favor of joint selections of the other two. 

The 200 items selected for the ten scales were then reproduced 
and administered as described to the 131 subjects of Group A. After 
processing of the results as described, a product-moment correlation 
matrix was computed furnishing both item-item and item-total correla¬ 
tions for each scale for use in item selection. 

Item scores were then factor analyzed. Due to the 155 variable 
limitation of the Burdsal program, it was necessary to split item varia¬ 
bles into two samples. Division of the data into two samples with five 
scales each was considered, since in this way all items could be inves¬ 
tigated with reference to the same factor. However, in view of the 
planned reanalysis of selected items and as a partial check on the 
stability and consistency of any factor structure shown, considering 
the large probability of chance clustering in such a small sample, it 
was decided to include half the items on all ten scales in each factor 


analysis. 

The finding of factors defined primarily by items specific to 
a scale as described in the results section made possible further se¬ 
lection of items on a multiple criterion basis to decrease their num¬ 
ber to 15 for each scale. Considerations in maintaining items were 


high factor loadings on the appropriate scale factor, hign item-total 
correlations, and low item-item correlations. Since hi.,n loadings or. 


same factor would normally involve a high proportion or 


e omw.v 
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inconsistent criteria of necessity involved a degree of balance and 
compromise. The overall objective was to obtain sufficient heteroge- 
niety for maximum ultimate validity while retaining sufficient internal 
consistency among items for minimal standards of reliability and factor 
structure. 

The remaining 130 items were then again factored to insure that 
the scale factors found in the separate analyses were indeed parallel; 
to check on the efficiency of the item selection; to determine if all 
scales appeared as factors defined by scale items; and to provide a 
means of selection for the final 100 items to be used in the IBT. 

On the basis of factor loadings in this analysis, final items 
were selected. In several instances items were moved from one scale 
to another on the basis of consistently higher loadings on the factor 
representing the other scale. In each case the appropriate item and 
scale correlations were examined to confirm the greater relevance of 
the item to the unexpected scale. 

Since factor loadings were the primary criterion in this last 
selection, it became apparent that a balance of items with direct and 
reverse scoring could not be maintained. Although these were evenly 
divided on several scales, others had as much as a 5 and 7 division 
in different directions according to the individual scale. It was 
decided that greater exposure to bias from acquiescent tendencies woulu 
not be as harmful to the final instrument as would a loss of factor 
relevance for the items; therefore items were retained as dictated by 
factor loadings. 

The final 100 items were then refactored to determine what modi¬ 
fications of factor structure had occurred as a result of the deletion 
of other items. Three items which dropped substantially in loadings 


were replaced with others having greater item-item and item-total co: 
relations. According to the format description already given, items 
were then arranged so that item numbers would, reflect scales. Care 
was taken to insure random arrangement of direct and, reversed items 


and sufficient separation of items with, sim.lar overt cor.tent. 


reproduction of the test as final lx- administered mar he see:, in. 



Appendix. 
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Construct Validation 


When measurement is attempted in a new domain where no external 
criterion for validation yet exists, it is necessary to establish vali¬ 
dity of the instrument in terms of the relationships of scores to the 
constructs internally defined through the data itself. The most appro¬ 
priate method of establishing construct validity is through factor 
analysis. Constructs measured by the instrument are defined by factors 
which can be replicated in other samples if they represent real, func¬ 
tionally unitary, psychological dimensions. Tf so, then valiuity of 
the instrument in the measurement of the construct becomes a function 
of the loadings or correlations with the factors of test scores. Since 
the factors themselves and the constructs they represent are most 
usually defined through qualitative analysis of the content of vari¬ 
ables most highly loading the factors, this method of validation 
incorporates the concepts of both content and construct validity. 

This method of validation was utilized with the IBT both to 


insure the distinctness and stability of the irrational beliefs in 
Ellis' system as constructs and to determine the extent to which the 
IBT was able to measure those constructs. Although the existence of 
factor structures defining the hypothesized constructs in one sample 
is comforting, the replication of these factors in a separate nonho- 
mogenous sample provides a much more powerful basis for accepting 
construct validity. Since selection of items for a test based on 
factor structure in one sample of necessity incorporates not only the 
true, stable sources of variance common to the items but also chance 
correlations of items unique to the sample, it is normally expected 
that a certain amount of shrinkage and change in factor loadings will 
take place in replication attempts. 

Therefore the procedure used in construct validating the IBT 
involved comparison of factor structures in both initial and cross 
validation samples, calculation of validity coefficients in both sam¬ 
ples for comparison and determination of shrinkage, and; the attain¬ 


ment 
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difficulty the correlation of total scores with a criterion can he esti¬ 
mated by dividing the mean item-total correlation into the mean item- 
criterion correlation. This method was used for both samples, A and b. 
However, for sample A no item-total correlations were available since 
the only scale scores computed hv special program included all 2U items 
per scale in the original admin is: .at ion. Therefore an estimate of 
item-total correlations was ‘uTiculutod using Richardson's method (1956) 
and the available item-item correlations. 


The a priori decision as to the minimum acceptable validity for 
the IBT was difficult to make for several reasons: (1) As with relia¬ 
bility, less intrinsic validity should be expected of a research test 
than of a refined instrument in applied use. (2) The nature of the 
domain measured had not been sufficiently investigated to warrant good 
estimates of the maximum validity that could reasonably have been ex¬ 
pected. Whereas measures of specific abilities or achievements may 
obtain validity coefficients from .80 to .95, the more complex the 

domain the niore likely it is that validity will drop. Cronbach (1960) 

\ 

states that its very unusual for a validity coefficient to rise above 
.60 outside these areas. Many personality, motivation, and interest 
measures in general use report construct validities as low as .40. 

(5) The small number of items per scale ia the IBT required tolerance 
in setting minimum bounds for validity, s,..ce it is a function of test 
length. (4) liven experts in the field of measurement differ among 
themselves as to an acceptable level for validity. Established author¬ 
ities such as Guilford (1954) and Nunnallv (1967) avoid setting any 
absolute standards, but their high, expectations are obvious. Those 
more concerned with practical problems or measurement in applied 
settings such as Guion (1965) seem willing, to be satis: iod with vali¬ 
dities as low as .50 and .40. Cronbach fI960) states the general 


position succinctly bv saying a good val.ditv coefficient is one t.'iat 
is "the best you can get." The values stated in the research Hypo¬ 


thesis were therefore 
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Descriptive S t a tis tics 


Using standard computer urograms as d ■ .r ribed . v.. rinus .loser 
tive statistics regarding T B’ scales ua'.s- u-‘r ' - ed ::v;,i ; ;;o saor.-^ n; 
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sample B subjects. These included means, standard deviations, standard 
errors, maximum and minimum values, and coefficients of skewness and 
kurtosis. Results were surveyed for characteristics of importance in 
measurement. 


Reliability 

The reliability of a test most commonly refers to homogeniety 
or internal consistency although quite often the term is also applied 
to calculations of stability and equivalency between forms. Both 
homogeniety coefficients and stability coefficients were calculated 
for the IBT. 

In accordance with the suggestions of Guilford (1954) and ,\un- 
nally (1967), an absolute minimum homogeniety of .50 and a desired 
minimum of .60 was set as a goal of test construction, taking into 
account the research nature of the instrument and the expected scale 
length of only ten items. 

The estimation of homogeniety was accomplished by two different 
methods. The first utilized a two way analysis of variance without 
replication of a matrix of item scores against subjects for each scale 
in accordance with the'suggestions of Hoyt (1941). The second utilized 
mean item-item correlations in a Spearman-Brown formula with the mul¬ 
tiple, "n," equal to the number of items in accordance to Guilford's 
suggestion (1954). Mean item-item correlations were calculated by 
Richardson's formula (1956) using mean item-total correlations. 

It was decided not to calculate the more usual split-half relia¬ 
bility coefficients due to the difficulties involved in writing and 
checking special computer programs for processing and scoring the data 
in this manner. However, this decision was made realizing that higncr 
values for reliability might have been obtained by tnat metnod. Hoyt's 
method is an extension of the rationale utilized in the kuder-Richaruson 
formula 20 (1957) anu would therefore non...illy provide results muen 
lower than split-hnl:' cooffieieats . Both methods used utilize assump¬ 
tions of item equivalency: and. as i.herrv and Gavloru i m -o) nave s.'.ov.;., 
in the normal situation where aetua] items unevenly measure common, 
factors, the resulting re 1 i d > : " vain ...need, , r. <:.v. 

values obtained fro.;. I »*>: r, * t in ,«;s us.-a .'.ere <. • •eab » v um.e res ». ;•••>. e> . 
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regression equation utilizing IBT scores. A multiple R was also com¬ 
puted for the total symptom score,, using IBT scales as predictors. 

In order to adequately investigate the hypothesis involving IBT 
scores and intelligence as measured by factor B of the 16Pi ; , the total 
sample was placed into a t-test program and the IBT scores of those 
scoring one half standard deviation or more above and below the mean 
on factor B were compared for significant differences. 

In order to determine if a significant difference in IBT scores 
existed between the general adult sample and the mental hospital sample 
all IBT scores of the two groups were compared using the t-test program 

Demographic Variable Relationships 

Age, sex, and education level variables were correlated with IBT 
scores, and the values were investigated for significance using stan¬ 
dard tables. 

In addition, the t-test program was used to investigate the sig¬ 
nificance of differences between mean scores of males and females and 
of high and low education groups on the IBT. For the latter test, 
variance was maximized by comparing those with two or more years of 
college with those who failed to complete high school. 






CHAPTER III 


RESULTS 

Test Construction 

In the two factor analyses done on the divided 200.item first 
administration, ten factors were extracted with both varimax rotation 
to orthogonal simple solution (Kaiser, 1956) and promax rotation to an 
oblique solution (White, 1962). The results were highly gratifying for 
an initial analysis. All scales were defined by factors in at least 
one of the two analyses with most being represented in both. The re¬ 
presentation of scales by factors was much more definitive and unique 
in the varimax matrix than in the promax matrix. There were some fac¬ 
tors which could not be identified through content analysis of loading 
items and which evidently represented chance clustering of items. In 
subsequent analyses, therefore, a greater number of factors were ex¬ 
tracted than would be required to explain the scales in order to allow 
them to appear as factors if possible. 

In the analysis of the 130 selected items 15 factors were ex¬ 
tracted and rotated in the same manner. As in the previous analysis, 
item loadings were much more definitive of scale factors in orthogonal 
structure than in oblique solution. All scales were well defined by 
factors, with most of the items in each scale showing satisfactory 
correlations with the orthogonal factor representing the scale. The 
final selection of items was then made as described and these 100 
items were used in determining the construct validity of scales for 
the initial sample. 


Construct Validation 


items , 


Even though the initial sample. Group A, was administered 200 
only the items successfully passing all steps in selection wore 


35 





34 

considered in determining construct validity of the instrument in this 
first sample. In the factor analysis of final items, 15 factors were 
secured accounting for 86.6% of the total variance. Of these 15 fac¬ 
tors, 10 were clearly identifiable by items of a specific scale. These 
10 factors accounted for 73.2% of the total variance and 45.4% of the 
original communality estimated in all factors. The varimax matrix re¬ 
sulting from this factor analysis may be seen in the Appendix. Each 
of the 10 factors was clearly identified as representing one of the 
irrational belief scales as the result of relatively pure and consis¬ 
tent higher loadings of items unique to the scale on the factor. The 
mean loadings of scale items for each scale represented by a factor may 
be seen in Table 2. Also listed for each of the factors is the number 


TABLE 2 

COMPARISON OF MEAN FACTOR LOADINGS OF IBT SCALE 

ITEMS IN TWO SAMPLES 


Factor- Irrational Beliefs 

Scale as Described by 

No. Resultant Behavior 

Group A, 

N=131 

Group B, 

N=427 

Mean 

Loadings, 
Scale 
Items 

Other 

I terns 
L'd'g 
.225 

Mean 

Loadings, 
Scale 

I terns 

Other 
I terns 
L’d’g 
. 225 

1 

Demand for approval 

.628 

15/90 

.362 

5/90 

2 

High self expectations 

.413 

8/90 

. 300 

5/90 

3 

Blame proneness 

. 566 

6/90 

.324 

3/90 

4 

Frustration reactive 

.384 

3/90 

.248 

5/90 

5 

Emotional irresponsibility 

.401 

7/90 

.393 

9/90 

6 

Anxious overconcern 

.493 

11/90 

. 42S 

15/90 

7 

Problem avoidance 

.551 

4/90 

.554 

:/do 

8 

Dependency 

.411 

7/90 

.276 

6/90 

9 

Helplessness 

.378 

5/90 

.284 

2/90 

10 

Perfectionism 

.358 

5/90 

.528 

1 / 9C 





35 

of other items loading that factor with coefficients greater than .225, 
the approximate value for a .05 level of significance. Obviously a 
large proportion of the variance was extracted in factor 1 with conse¬ 
quent greater impurity of factor definition. It should be noted that 
no factor was pure in the sense that all scale item loadings were high 
with all nonscale items low. In all cases there were occasional non¬ 
scale items that loaded a factor more than some of the scale items, 
and at least half the scale factors had one or more items whose load¬ 
ings were too low to be considered significant alone. However, these 
items were for the most part acceptable in view of the facts that (1J 
item-item correlations and item-total correlations initially were 
acceptable and indicative of shared communality with other scale 
items; (2) the small size of the sample severely inflated the possi¬ 
bility of spuriously low intercorrelations and resultant factor load¬ 
ings as well as high ones; (3) it was doubtful that good simple 
structure and adequate rotation had been achieved due to the maximi¬ 
zation of variance during rotation impartially increasing the stronger 
nonscale item loadings at the expense of several scale items with 
smaller loadings. As noted in the previous chapter, only three items 
of the 100 were replaced to increase validity, and these items are 
included in neither the mean item loadings in Table 2 nor the later 
reported coefficients of construct validity. 

Research Hypotheses 

Research Hypothesis 1 .-- As determined by factor analysis, the 
irrational beliefs enunciated by Ellis are sufficiently distinct in 
content and stable in structure to be measurable as separate constructs 
defined by factors which can be replicated in a separate nonhomogeneous 
population. 

Although the very satisfactory factor structure obtaineu in the 
original validation sample provides strong evidence tnat tae ideas or 
beliefs which the items were designed to measure are indeed separate 
constructs defined by factors, this evidence is not strong enough to 
stand by itself. There is always the possibility that in the distil¬ 
lation of items through repeated analysis true communality m sm.»li 
amounts may be lost while chance 


communality unique to the sample is 
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maximized. Such a possibility in the present study was greater than 
usual due to the exceedingly small number of subjects and the exceed¬ 
ingly large number of variables initially. For the valiuation of 200 
items, Nunnally (1967) or Guilford (1954) would have recommended 2,000 
subjects but would have accepted 1,000. Guion (1965) and many others 
used to working in applied settings with limited samples would have 
still insisted on at least 400, or two times the number of variables. 
Because of practical restraints and self-confident optimism resulting 
from the knowledge that well written and selected items with high in¬ 
trinsic validity and reliability will shine like pearls in even a small 
sample, a goal of 250 subjects for initial validation was set in this 
study. As appears to be customary in such situations, a large part of 
this number were not available at the time of testing, causing a resul¬ 
tant N of 131. Replication was therefore necessary for any assurances 
that real constructs had been measured rather than carefully assembleu 
artifacts. 

The homogeniety of the sample also called into question the 
transferability of any valid factor structure found, so replication 
was necessary on a sample heterogeneous in as many respects as possible, 
particularly with respect to the initial sample. In order to attempt 
confirmation of the hypothesis, therefore, the IBT was administered to 
427 subjects from heterogeneous groups as described and the resultant 
scores were factor analyzed. 

In this analysis, 15 factors extracted 94.1% of the total vari¬ 
ance. Again 10 factors were readily iuentii ied through the relative 
uniqueness or specific scale ito.i. lCuuiugs. inese 10 ructors accounted 
tor 90.2-6 or tne «~0 lu 1 Variance a.. a / o . — j o^ c n e or.na. c o i. m * u n a i i *. v 
estimated in ail the factors. As snown m Table 2, t..e mean loadings 
of scale items on the factors representing the same scales cropped 
substantially from those obtained in the original analysis, even though 
they remained in acceptable limits considering the larger .\ or tne 
sample. In general, the relative purity of tne factor structure was 
improved for scales, using the same absolute value for com.par i sen.. As 
in the preceding analyses, promax rotation into oblique solution ob¬ 
scured the cleaner factor-scale relationships seen m the variwax 
matrix. The latter mav be seen in the Appendix. 

4/ A i 
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On the basis of factor analysis of data from the cross valida¬ 
tion sample with replication of factor structure. Research Hypothesis 
1 was confirmed. 

Research Hypothesis 2 .-- As determined by factor loadings of 
scale items on factors defining the scales, construct validity of IBT 
scales will exceed a minimum acceptable value of .40. 

In Table 3 may be seen construct validity coefficients for both 
the initial and cross validation samples. The values for .the initial 
sample appear spuriously high, although how much too high is something 
that is not calculable. The inflation of these values is in all pro¬ 
bability a function both of the process of boiling down items with 
uniqueness as well as true communality maximized and of failure to 
meet fully the assumptions of equivalency of items in the statistical 


TABLE 3 

IBT CONSTRUCT VALIDITY COEFFICIENTS 


Factor- 

Scale 

No. 

Irrational Belief 
as Described by 

Resultant Behavior 

Initial 
Validation 
Group A 

N=131 

Cross 
V a 1 i d a t 
Group ' 
N=427 

1 

Demand for approval 

.946 

.676 

2 

High self expectations 

.850 

.629 

3 

Blame proneness 

.890 

.747 

4 

Frustration reactive 

.876 

.561 

5 

Emotional irresponsibility 

.931 

.824 

6 

Anxious overconcern 

.978 

.802 

7 

Problem avoidance 

.921 

.714 

8 

Dependency 

.957 

.679 

9 

Helplessness for change 

.958 

.619 

10 

Perfectionism 

.991 

.757 
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procedures. The estimation of mean item-total correlation as the 
square root of mean item-item correlation according to Richardson's 
formula (1936) is an approximation at best. And if through lack of 
homogeniety in items this value is inflated, then Humphrey's formula 
(Guilford § Lacey, 1947) would be strongly affected. 

However, the coefficients seen in Table 3 for the cross valida¬ 
tion sample are based on direct item-total correlations and fall in 
the very satisfactory portion of the expected range. The large de¬ 
crease in computed validities between the initial sample and the cross 
validation sample is to be expected for the reasons previously des¬ 
cribed. Considering the small N of the initial sample, the mainte¬ 
nance of coefficients at the high level shown for Group B is strong 
support for the IBT as a well validated instrument on the basis of 
constructs shown by factors. The requirements of Research Hypothesis 
2 are well exceeded, and therefore this hypothesis was confirmed. 

Descriptive Statistics 

Table 4 gives descriptive statistics computed for all scales of 
the IBT and for total score. An unusual finding is that for most of 
the scales the mean for the total sample of 427 subjects is very close 
to the mean of minimum and maximum possible scores. The three means 
which do not conform to this are slightly lower, but not substantially 
so. On all scales it is possible for a subject to deviate as much as 
2^ standard deviations from the mean in either direction. The variance 
is sufficiently large for adequate discrimination, yet not so much so 
that there is apt to be jamming at either end of the distribution. The 
latter observation is confirmed by actual maximum ana minimum values 
of scores in the data. Only six of the twenty-two possible extreme 
scores were attained by anyone in the sample of 427 subjects. Since 
users of the test would be primarily concerned with discrimination 
between high scorers rather than low scorers, the positive skew of 
the score distribution on most scales is beneficial and desirable. In 
two distributions there is very mild negative skew, and only scale S 
has any substantial degree of negative skew. 

In general it may be said that the descriptive statistics tor 
all scales show satisfactory and acceptable values. 
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TABLE 4 


DESCRIPTIVE STATISTICS FOR IBT SCALES 

N = 427 


IBT 

Scale 

Mean 

Std. 
Dev. 

Std. 

Error 

Max. 
Value 

Min. 

Value 

Skew¬ 

ness 

Kur- 

tosis 

1 

31.41 

6.69 

.324 

50 

10 

. 130 

-.069 

2 

31.03 

5.85 

.283 

50 

13 

.273 

.382 

3 

30.11 

5.64 

.273 

46 

14 

-.055 

-.012 

4 

31.16 

5.40 

.262 

47 

12 

.034 

. 181 

5 

25.07 

5.91 

.286 

44 

10 

.375 

. 136 

6 

30.94 

7.19 

.348 

50 

11 

-.058 

- . 366 

7 

25.88 

6.16 

.299 

43 

10 

.202. 

-.382 

8 

50.79 

4.98 

.241 

44 

11 

-.280 

.554 

9 

28.05 

6.22 

.301 

47 

13 

.175 

-.162 

10 

27.09 

5.87 

.284 

46 

12 

.261 

. 178 

Full 

291.54 

31.73 

1.537 

415 

180 

. 143 

.810 


Reliability 


Research Hypotheses 


Research Hypothesis 3 .-- The IBT will have sufficient homogene¬ 
ity within scales to provide a minimum acceptable internal consistency 
reliability of .50 in any scale and a mean reliability of .60 for all 
scales . 


As previously 
to provide estimates 
give underestimates 
correlation corrccte 
fact, it may be seen 


uiscusseu, the two metnous utilizer in trie stare 
of internal consistency reliability beta tend to 
under average conditions comparer to a split-ha If 
d by the Spearman-Brown formula. Despite this 
from Table 5 that applying both methods to ;ni 
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TABLE 5 

RELIABILITY COEFFICIENTS FOR IRRATIONAL 



BELIEFS 

TEST (IBT), N‘ 

=427 


IBT 

Scale 

Irrational Beliefs 
as Described by 
Resultant Behavior 

Homogeniety Homogeniety 
Hoyt's Guilford's 

Method Method 

Stability * 
Test-rctest 

N=52 

1 

Demand for approval 

.724 

.801 

.830 

2 

High self expectations 

.623 

.747 

.872 

3 

Blame proneness 

.566 

.714 • 

.775 

4 

Frustration reactive 

.550 

.712 

.675 

5 

Emotional irresponsibility .621 

.746 

.754 

6 

Anxious overconcern 

.724 

. .798 

.856 

7 

Problem avoidance 

.659 

.745 

.827 

8 

Dependency 

.450 

.662 

.857 

9 

Helplessness 

.589 

.726 

.676 

10 

Perfectionism 

.585 

.714 

.676 

Full 

Irrational Beliefs in General 


.921 

Mean of Individual Scales 

.609 

.737 

.796 


scales only yielded one value failing to meet the hypothesis. 

Using Hoyt's method with analysis of variance, the mean relia¬ 
bility of scales was .609 with a range from .450 to .724. Only one 
scale was below .550. Using Guilford's method and employing item-item 
correlations, homogeniety values were found from .662 to .801 with a 
mean over scales of .737. Scales 1 and 6 were shown to be the most 
reliable by both procedures, while scale 8 was found to have the least 
internal consistency. 

Although it is more probable that other methods of estimating 
reliability would approach the higher values rather than the lower, a 
conservative estimate would allow an average of the two to be the 
closest estimate of actual homogeniety. The lowest reliability 
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Research Hypotheses 

Research Hypothesis 5 .-- There will be a significant positive 
functional relationship between irrational beliefs as measured by the 
IBT and the self-report of maladjustment symptoms. 

Correlation coefficients between all IBT scores and all items 
of the Symptom Measure as well as total score are shown in Table 6. 

It is evident that with the exception of IBT scales 8 and 10, highly 
significant relationships existed as hypothesized. Every item in the 
Symptom Measure correlated with IBT scales 2, 6, 9, and total score 
with values exceeding by far the .0005 level of significance. All but 
a few items correlated with scales 1, 4, 5, and 7 in the same manner. 
Only scales 8 and 10 appear to have no association with admitted symp- 
tomology beyond occasional chance correlation. 

However, inspection of the regression equation in Table 7 with 
symptom admission predicted by IBT scales shows that both 8 and 10 
were useful as a negative function in prediction. The explanation 
for this of course lies in the fact that their value in prediction 
rises if they share less common variance with other scales. Referral 
to the correlation matrix of scores in the Appendix will confirm that 
relatively smaller correlations with other scales are presented by 
these two. 

The very high multiple R of .717 between total symptom score 
and IBT scales strongly confirms the research hypothesis and the under¬ 
lying rationale of a direct relationship between psychiatric complaints 
and incidence of irrational beliefs. This finding is enhanced even 
further by the fact that despite the anchoring of IBT scales on ortho¬ 
gonal factors, eight of them were required to establish this multiple 
correlation. This implies the inherent validity of the instrument as 
a combination of measures well suited for prediction or explanation in 
the area of emotional disturbance and maladjustment 

On the basis of both correlations with individual IBT scales 
and multiple correlation using the scales as predictors, the relation¬ 
ship hypothesized was shown to exist for all scales except 8 and 10. 

Scrutiny of correlations in Table 6 relative to each other pro¬ 
vides insight into the dominant symptoms of persons with specific 
irrational beliefs. For example, with Belief 1 a person tends 
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really to worry, feel inadequate and unhappy, and easily become tense 
or depressed. Yet he has little inclination to anger easily, be re¬ 
sentful, or feel alienated from others; people and their approval are 
too important to him. On the other hand, those high on Belief 3 who 
believe in blame and guilt show anger easily, are resentful, lack 
interest, find life dreary, and often feel like giving up. Many of 
the outstanding symptoms have high face validity for the irrational 
belief correlating most highly. For example, the highest correlation 
for Belief 7, problem avoidance, is the symptom of lack of willpower. 

Research Hypothesis 6 .-- There will be a significant positive 
functional relationship between irrational beliefs as measured by the 
IBT and scales C-, H-, L+, 0+, Q3-, Q4+ of the 16PF. 

In Table 8 may be seen correlation coefficients computed between 
all the variables involved in this hypothesis, with 16PF factors ar¬ 
ranged in the general order of their usual clinical significance. 
Immediately apparent is the repetition of the pattern found with symp¬ 
toms as criteria. IBT scales 8 and 10 showedno significant correla¬ 
tions or even steady trends with these 16PF scales, while most of the 
correlations involving other IBT scales were highly significant beyond 
the .0005 level. Both scale 6 and total score showed consistent very 
high correlations with all clinical personality factors, with 2, 4, 7, 
and 9 following closely. Of the 16PF factors, Q3 was less consistent 
in correlating with IBT scales than any other, and it had the lowest 
correlation with total score. 

As portrayed in Table 7, multiple R's of criteria 16PF scales with 
IBT scales as predictors ranged from .432 to .630, with Q4+, 0+, and C- 
having the highest correlations with the IBT. Inspection of the 
matrix of coefficients in the regression equations shows the varying 
contributions of differing irrational belief measures to the prediction 
of the anxiety component factors and illustrates the fact that all the 
philosophies measured by the IBT shared some common variance with the 
elements of the second-order anxiety factor. 

Despite the general overall positive relationship of IBT scores 
to these indices of emotional disturbance and maladjustment, excepting 
scales 8 and 10, it is evident that certain scales were aligned more 
closely with them than others. Scale 6 had consistent high correla- 
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TABLE 8 


CORRELATIONS BETWEEN IBT SCORES AND 16PF 
INDICES OF EMOTIONAL DISTURBANCE 
N=4 27 


IBT 

Scale 


16PF Clinical (Anxiety) Factors 
in order of general clinical significance 

• 

0+ 

Q4 + 

C- 

Q3- 

• L+ 

H- 

1 

.350 

.315 

.275 

.128 

.137 

.284 

2 

.356 

.383 

.317 

.228 

1303 

.361 

3 

.215 

. 189 

. 194 

.108 

.279 

.219 

4 

.350 

.467 

.295 

.296 

.257 

. 180 

5 

.178 

.082 

.186 

.028 

.046 

. 152 

6 

.515 

.527 

.421 

.335 

.341 

.326 

7 

.349 

.299 

.263 

.268 

.235 

. 533 

8 

.054 

.059 

- .053 

-.027 

-.047 

.029 

9 

.387 

.273 

.283 , 

.174 

.304 

.273 

10 

-.065 

-.091 

-.098 

-.047 

.012 

.006 

Full 

.527 

.491 

.411 

.293 

.356 

.422 


Note: Significance values for this N are .115 @ .01 level, .127 @ .005 
level, and .160 @ .0005 level for a one-tailed test. 


tions with every clinical personality factor and was the only IBT scale 
besides 7 which contributed to every multiple correlation with them. 

In some cases it correlated higher with them than did total score. 

The construct similarity between the second-order questionnaire 
factor of anxiety and IBT scale 6 was well demonstrated in the factor 
analysis wherein not only IBT items but also IBT scale scores and loPF 
scores were entered as variables. One of the purposes of this analysis 
along with item comparison was to replicate if possible the usual 16PF 
second-order factor structure and to compare factor correlations of 
these and IBT factors after oblique rotation. However, it was lounu 
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from the varimax matrix after orthogonal rotation that both IBT 6 and 
the anxiety factors from the 16PF loaded the same factor. Comparison 
of scale item loadings on this analysis with those obtained in the 
previous factoring of items only revealed the same relative values, 
indicating that the 16PF clinical items had "lined up" with the scale 
6 factor due to a high degree of common variance. However, upon 
oblique rotation in the promax phase of the factor analysis program, 
it was found that even though IBT 6 loadings had become less defini¬ 
tive in accordance with previous experience, 16PF anxiety component 
loadings had completely disappeared as a pattern. It was therefore 
clear that IBT 6 and the second-order anxiety factor were not identi¬ 
cal, even though there was a high correlation involved. 

On the basis of the results shown in Tables 7 and 8, the hypo¬ 
thesis was confirmed with the exception of IBT scales 8 and 10 which 
portrayed no significant relationships with 16PF clinical scales. 

Research Hypothesis 7 .-- There will be no significant func¬ 
tional relationship between irrational beliefs as measured by the 
IBT and scales A, E, F, G, I, M, N, Q1, and Q2 of the 16PF. 

Computed correlation coefficients between the 16PF scales 
listed above and all IBT scores are shown in Table 9. At first, the 
absence of .500 to .600 correlations as shown by clinical factors 
leaves the impression that few significant relationships existed. 

But upon closer inspection it may be seen that of the 99 correlations 
involved, 9 of them were significant at the .05 level, 5 at the .02 
level, 16 at the .01 level, and 17 at the .001 level for a total of 
47 out of 99. Therefore the hypothesis could not be maintained. 

On many of these primary nonclinical personality factors it 
was clear that steady relationships were maintained with irrational 
ideas in general. For example, A- (reserved), E+ (assertive), F- 
(sober), N- (artless), and Q2- (group dependent) all tended to corre¬ 
late positively with IBT scores. On the other hand, some traits such 
as G (expedient vs. conscientious), I (tough-minded vs. tenuer-minded), 
and M (oractical vs. imaginative) tended to have positive relationships 
with some IBT scales and negative relationships with others. 

The more specific relationship of IBT scales to certain primary 


nr: 
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TABLE 9 


PRODUCT-MOMENT CORRELATIONS^ BETWEEN IBT SCALES 
AND NONCLINICAL 16PF FACTORS, N=427 


16PF Factors 


Scale 

A 

B 

E 

F 

G 

I 

M 

N 

Qi 

Q2 

1- 

-049 

-048 

-111 

-097 

038 

079 

022 

- i 55 

-151 

-169 

2 

-160 

-102 

118 

-175 

-096 

-012 

070 

-070 

-048 

007 

3 

-137 

-192 

093 

-138 

033 

-188 

-101 

-005 

-142 

-047 

4 

-052 

060 

106 

-070 

-048 

101 

157 

-157 

-032 

•005 

5 

014 

-053 

031 

-080 

-098 

-008 

-084 

-046 

141 

-036 

6 

-156 

-099 

059 

-131 

065 

047 

036 

-164 

-174 

-054 

7 

-097 

-016 

048 

-060 

-329 

089 

055 

-2o8 

042 

-005 

8 

120 

-013 

-153 

042 

148 

181 

-092 

-126 

-165 

-185 

9 

-171 

-183 

124 

-132 

-149 

-095 

078 

-137 

028 

-032 

10 

020 

-096 

007 

-060 

116 

-092 

-166 

035 

-062 

-076 

Full 

-135 

-144 

063 

-176 

-093 

017 

000 

-211 

-108 

-111 


^Decimals preceding coefficients omitted. Significant values for this N 
(2-tailed test): .093 @ .05 level; .127 @ .01 level; .160 @ .001 level. 


traits of personality was well demonstrated by the regression equations 
of Table 10, where IBT scales were used to predict nonclinical 16PF 
factors. In contrast to the number of scales used to build a multiple 
correlation with those traits loading anxiety, a much smaller number of 
IBT factors were used to predict the other 16PF scales. The multiple 
r' s were more moderate than those involved with clinical scales, yet 
without exception they were significant at less than the .01 level. 

Table 11 provides concurrent validation multiple R's done in the 
pgygpgg manner with 16PF scales used to predict each IBT score in turn. 
The 'complex interaction of a number of primary factors is well illus¬ 
trated in this table, as 10 and more 16PF scales contributed signifi¬ 
cantly in the prediction of IBT scores. All multiple correlui ions 
shown were highly significant with the inclusion of both clinical anu 
nonclinical 16PF scales in the regression equations. The multiple R 
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Stepwise regression terminated at an F to enter or remove significant at the .05 level. 
Decimals omitted; all values given should be multiplied by .001. 
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of 16PF traits with IBT total score was .666. 

Research Hypothesis 8 .-- There will be a significant negative 
functional relationship between irrational beliefs as measured by the 
IBT and intelligence as measured by scale B of the 16PF. 

The correlations between scale B of the 16PF and the various IBT 
scores are shown in Table 9. Significant values were obtained only for 
the total score and five of the scale scores, with three of these 
having very mild significance levels around .025. An indisputable re¬ 
lationship appeared to exist only with scales 3 and 9 and the total 
score. Scale 4 reversed the hypothesized relationship direction. 

Furthermore, inspection of Table 11 illustrates that factor B 
entered into the prediction of IBT scales only four times, one of these 
being for scale 4. The greatest overall contribution to prediction 
seemed to be for IBT 10, with a relatively large weight also being 
given B in predicting IBT 3. Factor B did not enter into the predic¬ 
tion of IBT total score at all. 

Table 10 lists a multiple correlation coefficient between factor 
B and the IBT scales of .261, significant at the .01 level. However, 
further inspection illustrates that only three IBT scales significantly 
affected this prediction of B; and again IBT 4 was one of the three and 
varied contrary to the hypothesis. 

Table 12 provides the results of the comparison between groups 
definitely discriminated on the basis of intelligence. It may be seen 
here that only IBT scale 9 highly discriminated the two groups, with a 
t significant at the .0015 level. Scale 3 approached the .01 level, 
.while scale 6 was within the .05 level of significance. None of the 
other scores were significantly different between the two groups. 

In view of the fact that the reliability and validity of factor 
B are so low compared to ordinary measures of intelligence, it is pro¬ 
bable that the t-test analysis shown in Table 12 was the most reliable 
test of the hypothesis. Therefore with the exception of IBT scales 9 
and 3 and to some extent 6, the hypothesis was not supported. 

The intelligent person seemed to differ in irrational beliefs 
from those less bright only in the tendencies to consider himself less 
bound by the past, to condemn and blame less, and to be less anxious 
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TABLE 12. 

COMPARISON OF IBT SCORES IN HIGH AND LOW 
INTELLIGENCE GROUPS AS MEASURED BY 
16PF SCALE B 

GROUP H WITH SCORES GREATER THAN .5 S.D. ABOVE MEAN, N=59 
GROUP L WITH SCORES LOWER THAN .5 S.D. BELOW MEAN, N=64 


IBT 

Scale 


Group 


1 


H 

L 


2 


H 

L 


3 


H 

L 


4 


H 

L 


5 


H 

L 


6 


H 

L 


7 


H 

L 


8 


H 

L 


9 


H 

L 


10 


H 

L 


Full 


H 

L 


Mean 

Std. 

Dev. 

F 

Sig. 

Lvl. 

t 

Sig. 3 
Lvl. 

31.31 

31.92 

6.80 

6.50 

1.10 

.726 

.-0.51 

.306 

30.42 

31.84 

6.19 

5.38 

1.32 

.280 

-1.35 

.090 

29.32 

31.64 

6.18 

4.96 

1.55 

.090 

-2.28 

.013 

31.10 
30.23 

5.96 

5.37 

1.23 

.419 

0.85 

.201 b 

» 

26.29 

25.77 

6.89 

5.69 

1.47 

.139 

0.46 

. 326 b 

29.37 

31.91 

7.80 

6.78 

1.32 

.281 

-1.92 

' .029 

27.41 

26.94 

5.81 

6.33 

1.19 

.510 

0.43 

.336 b 

30.37 

30.39 

6.25 

5.80 

1.16 

. 566 

-0.02 

.494 

27.02 

30.30 

6.41 

5.42 

1.40 

.192 

-3.05 

.0015 

27.24 

28.25 

6.20 

5.53 

1.26 

.378 

-0.95 

.173 

289.65 

299.19 

35.04 

31.22 

1.26 

.372 

-1.56 

.062 


One-tailed test 

Reverse relationship to that hypothesized 
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and preoccupied with fears. Since these are only three of the ten areas 
of irrational philosophies measured by the instrument, it would appear 
that even though brightness may assist a person in being more rational, 
especially in some ways, it does not offer a high degree of protection 
against the possession of the irrational beliefs listed by Ellis. 

Research Hypothesis 9 .-- The IBT will be a sufficient discrimi¬ 
nator of mental disturbance that patients in a mental hospital will 
attain significantly higher scores than will subjects from' a general 
adult population. 

The results of comparing the scores of the general adult group 
in sample B and the mental hospital inpatients in the sample are given 
in Table 13. In general, the hypothesis was confirmed at highly sig¬ 
nificant levels. The only exceptions involve scales 1, 4, and 8, with 
the latter two providing almost no difference in mean scores. The 
contrast between the results on these scales compared to the others is 
striking and is particularly surprising in view of the fact that both 
scales 1 and 4 showed high correlations with symptomology and the com¬ 
ponents of anxiety. 

Research Hypothesis 10 .-- There will be a significant negative 
functional relationship between irrational beliefs as measured by the 
IBT and age of the subjects. 

The correlations between IBT scores and age may be seen in Table 
14. With the exception of IBT scale 6, this hypothesis was not sus¬ 
tained. Even the correlation of scale 6 with age was very moderate, 
barely significant at the .025 level with a one-tailed test. All other 
scales with the exception of scale 5 showed minor correlations not even 
indicative of a trend. Scale 5 reversed the hypothesized direction ol 
the relationship with a correlation that would have been significant 
at the .05 level if the hypothesis had been nondirectional. 

Research Hypothesis 11 .-- Females will score significantly 
higher in irrational beliefs as measured by the IBT than will males. 

Correlations between IBT scores and sex are shown in Table 14. 
Except for IBT scales 1, 4, and 8 the hypothesis was not maintained. 
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TABLE 13 


COMPARISON OF IBT SCORES FOR A MENTAL HOSPITAL (H) 
SAMPLE, N=72, AND A GENERAL ADULT (GA) 
SAMPLE, N=177 


IBT 

Scale 


Group 


Mean 


Std. 
Dev. 



Sig. a 
Lvl. 


1 

H 

GA 

32.05 

31.05 

6.88 

6.69 

1.06 

.763 

1.04 


.156 

2 

H 

GA 

33.00 

30.32 

5.98 

5138 

1.24 

.269 

•3.29 


.0005 

3 

H 

GA 

32.32 

29.45 

5.92 

5.31 

1.24 

.258 

3.57 

< 

.0005 

4 

H 

GA 

30.82 

30.83 

6.30 

5.13 

1.51 

.031 

-0.01 


.498 

5 

H 

GA 

27.25 

24.14 

6.66 
5.59 

1.42 

.070 

3.50 

< 

.0005 

6 

li 

GA 

32.14 

29.34 

7.91 

7.19 

1.21 

.324 

2.60 


.006 

7 

H 

GA 

26.97 

24.38 

6.36 

5.67 

1.26 

.227 

3.01 


.0015 

8 

H 

GA 

30.78 

30.81 

5.26 

4.80 

1.20 

.349 

-0.04 


.484 

9 

H 

GA 

31.49 

26.31 

6.02 

5168 

1.12 

.544 

6.25 

< 

.0005 

10 

H 

GA 

29.17 

26.68 

5.50 

6.22 

1.28 

.242 

3.11 


.001 

Full 

H 

GA 

305.97 

283.29 

35.80 

28.66 

1.56 

.020 

4.79 

< 

.0005 


d ~ ^ ^ _ 

O H 6 ~ c d .1 .i.6u w wS I 
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TABLE 14 


CORRELATIONS BETWEEN IBT SCALES 
AND DEMOGRAPHIC VARIABLES 
N=427 


IBT 

Scale 

Sex 

M- F+ 

Education 

Level 

Age 

1 

.143 

-.080 

.026 

2 

-.067 

-.105 

.042 

3 

-.160 

-.228 

.017 

4 

.140 

-.029 

-.018 

5 

-.100 

-.075 

.099 

6 

.075 

-.202 

- . 102 

7 

-.046 

-.073 

-.060 

8 

.158 

-.030 

-.027 

9 

-.119 

-.207 

.021 

10 

-.176 

-.183 

.036 

, Full 

- .028 

-.234 

.004 


These three scales showed correlations significant beyond the .005 
level. Only one other scale even correlated in the expected direc¬ 
tion, however, and on four of the remaining seven scores men were sig¬ 
nificantly higher than'women. 

In further confirmation of these findings, the results of a t- 
test of the difference between means is shown in Table 15. Many of 
the computed probabilities were highly encouraging until the negative 
t values were noticed. 

It is apparent that a significant difference did exist between 
IBT scores made by men and women but that the direction of the rela¬ 
tionship was specific to each scale rather than there being a general 
trend for the whole test. 

Based on the results shown in Tables 14 and 15, it appeared that 
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women were more inclined to perceive approval as a need, to over¬ 
evaluate unpleasant events, to worry and be anxious, and to not be 
self-directing. On the other hand, men were more inclined to set 
high standards for themselves, to be blamers, to reject responsibi¬ 
lity for their emotions, and to be perfectionistic. 

As can be seen, total scores on the IBT were not significantly 
related to sex, since the sex effect in the various scales tended to 
cancel out in the summative scoring. 

Research Hypothesis 12 .-- There will be a significant negative 
functional relationship between irrational beliefs as measured by the 
IBT and education level of the subjects. 

On the basis of the correlation coefficients between IBT scales 
and education level in Table 14, the hypothesis was confirmed with 
significance'at the .05 level for half the IBT scales and the total 
score, with all the others correlating nonsignificantly but in the 
predicted direction. 

A t-test of the difference in means between high and low educa¬ 
tion groups as shown in Table 15 was even more definitive. Signifi¬ 
cance at the .0005 level was calculated for scales 3, 6, 9, and 10 
as well as total score. Only scales 4 and 8 failed to show strong 
trends toward significance. 
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TABLE 16 

COMPARISON OF IBT SCORES IN TWO GROUPS 
DIFFERING IN EDUCATION LEVEL: 

GROUP H (N=157) HAVING COMPLETED TWO OR MORE YEARS OF COLLEGE 
GROUP L (N=95) NOT HAVING COMPLETED HIGH SCHOOL 


IBT 

Scale 


Group 


1 


H 

L 


2 


H 

L 


3 


H 

L 


4 


H 

L 


5 


H 

L 


6 


H 

L 


7 


H 

L 


8 


H 

L 


9 


H 

L 


10 


H 

L 


Full 


H 

L 


Mean 

Std. 

Dev. 

F 

Sig. 

Lvl. 

t 

C • a 

Sig. 
Lvl. 

30.43 

31.68 

6.83 

6.29 

1.18 

.384 

-1.49 

.069 

30.04 

51.82 

6.51 

5.37 

1.47 

.045 

-2.35 

.Q10 

28.29 

31.99 

5.56 

5.45 

1.04 

.838 

-5.19 

<.0005 

30.96 

30.98 

5.48 

5.86 

1.14' 

.467 

-0.02 

.491 

24.58 

25.85 

6.15 

6.27 

1.04 

.831 

-1.57 

.059 

28.73 

31.87 

7.33 

7.22 

1.03 

.886 

-3.33 

.0005 

25.22 

26.17 

6.35 

6.50 

1.05 

.797 

-1.13 

.132 

30.85 

30.93 

5.52 

4.57 

1.46 

.048 

-0.11 

.456 

26.34 

29.64 

6.23 

6.26 

1.01 

.958 

-4.06 

<.0005 

26.00 

28.93 

5.81 

5.40 

1.16 

.446 

-4.05 

<.0005 

281.44 

299.86 

33.21 

31.34 

1.12 

.548 

-4.42 

< .0005 


a 


One-tailed test 





CHAPTER IV 


i - ; si :uss i ox 


Evaluation o f the Irrational B eliefs Test 

As initially stated, the primary purpose of this study was to 
validate as measurable constructs the ideas Ellis has proposed as irra¬ 
tional beliefs and to develop a written instrument sufficiently reli- 
able and valid for research purposes to measure the extent to which 
persons hold these irrational beliefs. On the basis of the data pre¬ 
sented, it appears that this goal has been successfully met. Every 
research hypothesis set up to qualify the attainment of this purpose 
was confirmed. IBT items have been successfully shewn to measure these 
beliefs as constructs defined by replicable factors and all the test 
characteristics including score distributions, homogeniety reliability, 
stability reliability, and construct validity exceeded expectations. 

In fact, in this research instrument these characteristics have been 
found to surpass those of many instruments of equal length now on the 
market and in applied use. 

These findings alone show that the 1 hi' can be used in further 
research involving irrational beliefs, thorebv providing a research 
tool or aid not before available. In addition, however, the findings 
of substantial relationships with clinics, eriteria indicate that the 
IBT can be used effectively as a clinical instrument. Exploratory 
clinical use of the test not incorporated ..s a part of this study has 
shown many advantages offered by it. hike other clinical instruments, 
it provides an economical and simple shortcut to greater understanding 
of the nature of a patient 's problems. It is nonoffensive ana non- 
threatening. Results are intelligible and easily explainable to the 
subject and thereby offer an additional, more objective, externa; con¬ 
firmation of material presorted by the therapist. It also arforus .1 
means of objectively measuring progress in therapv. 
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Despite the present usefulness of the instrument as developed, 
however, a number of possible improvements are also suggested by the 
data from the study. Since many scales contain items that do not mea¬ 
sure as well as desired, additional possible items should be gathered, 
administered to a sufficient sample together with the best of the pre¬ 
sent items, and statistically investigated in the same manner as the 
present study to furnish a larger item pool. Not only may weaker items 
be replaced, but the scales may be lengthened or expanded to two equi¬ 
valent forms in this manner. 

Work should be done to improve the presentation format, both to 
eliminate confusion in responding by the subjects and to provide the 
most simple method of hand scoring for the benefit of the user. 

As discussed elsewhere, additional research should be done into 
the relationship of scales which are deviant in some respects to ob¬ 
tain maximum usefulness from test information. Included should be 
efforts to determine if greater discrimination and prediction could be 
obtained through certain combinations of scores. 

Studies should also be run to determine how much reliability and 
validity would be gained or lost through use of 2, 3, or 6 position 
scaling instead of the present 5, taking into account other considera¬ 
tions should as ease in scoring and decrease in response bias of one 
kind or another. 

In short, even though the research instrument constructed in the 
study exceeded expectations, like any development it should continue to 
be improved for maximum usefulness. 

Quest ioils Raised by the Data 


IBT Scales 8 and 10 


These scales deviated substantially from the pattern shown by 
all other scales in correlating with indices o; anxiety and emotional 
disturbance. N'o relationships to these criteria were found tor scales 
S and 10. It is obvious on the basis or test statistics that these 
scales operated sufficiently well in measurement, altnougn scaie N v.;a 
not achieve as much reliability as the others. It couldi be poss;e.e 
tit at this deviance arises from nartiai error in the tneorv underlying 
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and others through rose-colored glasses. His favorite defense mechan¬ 
ism is repression. This is often the person who not only does not 
admit his own weaknesses but does not even see them. It is easy to 
see how this type of person can get into severe behavioral difficulties 
without facing reality honestly enough to incur anxiety and emotional 
turmoi1. 

The probability is that these scales do measure irrational be¬ 
liefs which either lead directly to maladjustment or at least lead to 
greater exposure to problems without the more common problems of symp¬ 
toms and anxiety. Evidently if these people are subject to anxiety 
they have learned to handle it through repression or other effective 
means. This possibility is of course only conjecture, but it should 
be investigated in future research with the IBT by validating scores 
on these scales against other external criteria of maladjustment not 
so highly connected with anxiety and against established instruments 
providing measures of repression and other defense mechanisms, such 
as the Defense Mechanism Index (Sweney, 1964). 

Xondiscriminating Scales for Mental Patients 

A very unusual finding involved the failure of scales 1, '1, and 
8 to differ substantially in normals and mental patients, while all 
other scales showed extremely significant differences. Is there some¬ 
thing about the person with Irrational Beliefs 1 and -i that keeps him 

Out O 1 e i i C U O b J i. t ci X ^ U v S ^9 x L V J . > £5 ' ‘ y ‘J. J _ ^ 0 • i Cl a. 0 f 
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external support. This may be a neurotic core that leads to much un¬ 
happiness and emotional turmoil without the severity of mental illness 
that leads to hospitalization. 

Even though Belief 2 also involves this aspect of demanding 
rather than preferring, the basic involvement here is with oneself, 
with overly high standards and inner goals. The content of other 
highly discriminating beliefs is also more personalized than exter¬ 
nally oriented. Even the blaming and condemnation of Belief 3 may be 
turned primarily inward. So it may be that coping with internal stress 
is more likely to bring someone into the hospital than evaluating and 
working with external problems. Inspection of the content of the 
irrational beliefs providing the greatest discrimination shows the 
presence of highly dissonant areas involving high expectations and 
demands from oneself while at the same time abdicating responsibility 
for one's feelings and behavior. This might be more simply expressed 
as "1 have to and I can't," incompatible and irreconcilable beliefs 
that would place anyone under severe stress if he accepted both simul¬ 
taneously. 

Irrational Beliefs and Age 

The only IBT scale that showed even a mild relationship with 
age as expected was scale 6. This finding was at least consistent with 
the rationale of the hypothesis, since anxiety has been shown to de¬ 
crease with age and scale 6 is the highest IBT correlate of anxiety. 

If, as Ellis believes, irrational beliefs are a contributing cause of 
anxiety and disturbance, then the possibility is suggested by the 
findings that since these beliefs do not seem to decrease with age, 
much of the decrease in anxiety and disturbance with age must be attri¬ 
buted to suppressor variables, more adequate defenses, and controls 
which result from life experience. This explanation would be consis¬ 
tent with the interactive view of behavior as being multiply uetermined 
and does not negate the possible role of irrational philosophies in 
emotional problems. 




64 


Intelligence, Education, and Irrational Beliefs 

Another surprising finding involved a low degree of inverse cor¬ 
relation between IBT scores and a measure of intelligence with a high 
inverse relationship between the IBT scores and education level. The 
contrast between the two supposedly highly correlated areas is striking 
Obviously any relationship between education and decreasing incidence 
of irrational pitilosophics cannot be explained as an artifact resulting 
from higher intellectual ability. The most reasonable explanation 
seems to be that the introjection of values and beliefs from the gene¬ 
ral millieu which so greatly shapes the individual's philosophies and 
attitudes may work to his advantage in modifying them in a more ra¬ 
tional direction as he is influenced by the climate of formal education 
Such a speculation is comforting to those who would prefer to think of 
institutions of higher learning as shaping the whole person benefi¬ 
cially rather than simply acting as "fact factories". 

No partial correlations were done in this study, and the ques¬ 
tion is also raised whether or not intelligence would actually show a 
positive correlation with irrational beliefs if education level were 
not confounding the results. An indirect answer to this question is 
furnished by the fact that in a specific education level group, the 
college seniors of Group B, most of the IBT scales did indeed show a 
positive correlation with intelligence. Future studies should involve 
partial correlation techniques to determine the actual relationship 
of each of the variables to the various IBT scales. 


Implications of the Data for Ellis' Position 

To the extent this study was structured to do so, the results 
show strong confirmation of Fllis' theoretical system and position. 
His exposition of irrational ideas was shown to be accurate in that 
they are functionally distinct constructs measurable in heterogeneous 
populations. Although causal relationsnips could not be and were not 
confirmed by the data available from this study, the existence of 
highly significant functional relationships as hypothesized between 
most irrational beliefs as measured by the IBT -and every index or 
disturbance in the study leaves strong implications or validity for 
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Ellis' approach. Although as discussed two of the ten beliefs set out 
by Ellis did not correlate with these indices, the lack of a relation¬ 
ship between them and neurotic behavior is not disproved due to lack 
of range in the criteria. 




CHAPTER V 


SUMMARY 


In the development of rational-emotive therapy, Albert Ellis has 
postulated among other things a system of beliefs or philosophies common 
in our culture which are inherently irrational find conducive to malad¬ 
justment and emotional disturbance. In this study an instrument was 
constructed to measure these beliefs using factor structure as criteria. 
The instrument was then also validated against indices of personality 
and maladjustment. 

Initial item selection was by consensual validation of content 
with judges. Following administration of these items to an initial 
student sample, scores were factor analyzed and factors found defined' 
by the irrational beliefs. Further item selection was on the basis of 
factor loadings and intercorrelation analysis. The final instrument, 
called the Irrational Beliefs Test or IBT, consisted of 100 items 
measuring ten irrational beliefs in separate scales, all of them vali¬ 
dated against orthogonal factors. Cross validation of construct vali¬ 
dity was then made with a heterogeneous sample of 427 subjects. The 
factor structure upon which the test was based was replicated satis¬ 
factorily and construct validities were found in the cross validation 
sample ranging from .561 to .824 with a mean of .699. ilomogeniety 
reliability coefficients for the 10 item scales were found to range 
from .662 to .801 with a mean of .757, based on intercorrelations of 
item scores and scale scores. Stability based on 24 hour test-retest 
correlations of scores was .921 for full scale, ranging from .675.to 
.872 for individual scales. Descriptive statistics for score distri¬ 
butions were calculated and found satisfactory. 

As criteria for concurrent validation of the instrument a;u 


investigation of Ellis' theoretical position with respect to irrational 
beliefs, ail subjects in the cross validation sample were also auminis- 
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16 PF 


!5 item measure of admitted common psychiatric 


symptoms. The relationship of age, sex, 
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to irrational beliefs as measured by the IBT was also investigated. 

All IBT scales but two correlated highly with admitted symptomo- 
logy. IBT total score correlated .611 with the summated symptom score, 
and a multiple R of .717 was found between symptom admission and IBT 
scales. The same eight IBT scales correlated highly with the six 16PF 
factors common to all clinical groups and comprising the second-order 
questionnaire factor of anxiety. Individual IBT scales varied in their 
relationship to specific clinical personality factors; but IBT total 
score correlations averaged .417 and multiple R's from .432 to .630 
were seen with a mean of .526. Less impressive but significant rela¬ 
tionships of IBT scales with nonclinical personality scales of the 16PF 
were also determined. 

Differences in IBT scores between a normal adult sample ana a 
mental hospital sample were investigated and found to be highly signi¬ 
ficant for 8 of the 11 scores, most of them beyond the .0005 level. 

Age was not found to be significantly related to irrational be¬ 
liefs as measured by the IBT, but highly significant sex differences 
were found specific to scales. Although intelligence was a significant 
inverse correlate of IBT scores on only several scales, education level 
had a much greater negative functional relationship that involved most 
scales. 

It was concluded that on the basis of the data the IBT was suf¬ 
ficiently reliable and valid as a measure of irrational beliefs for use 
in both research and specific clinical needs, although suggestions for 
refinement were made- Ellis' theoretical position with respect to the 
irrational beliefs was substantially confirmed by the results of the 
study, although due to its nature no causal relationships could be 
established. Implications and interpretations of specific findings 


were discussed. 
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APPENDIX A 

VARIMAX MATRIX 

FROM FINAL IOO ITHM FACTOR ANALYSTS 
GROUP A, N=331 

Key 


Scale 

Factor 


Items 

used : 

in Validation 

1 

1 

1 

15 

21 

31 

57 

64 

73 

81 

88 

92 

2 

6 

8 

28 

32 

38 

48 

51 

65 

82 

83 

98 

3 

9 

2 

9 

22 

29 

59 

45 

58 

70 

77 

★ 

4 

12 

12 

16 

23 

4 0 

5 2 

59 

78 

85 

93 

* 

5 

4 

13 

17 

41 

53 

60 

71 

74 

89 

94 

99 

6 

5 

3 

18 

24 

33 

46 

61 

66 

79 

84 

90 

7 

8 

4 

* 

34 

42 

47 

49 

62 

67 

75 

80 

8 

3 

5 

11 

25 

30 

35 

43 

55 

91 

95 

100 

9 

7 

6 

26 

56 

44 

50 

63 

68 

72 

86 

96 

10 

10 

7 

14 

19 

20 

27 

37 

56 

76 

87 

97 


*indicates item replaced by another and not used in 
calculating validity 
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APPENDIX B 


VARIMAX MATRIX 
100 ITEM FACTOR ANALYSIS 
GROUP B, N=427 
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Scale Factor 
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Note: This factor analysis was performed 
on raw item scores before reversal for 
scoring. Therefore signs must be ignored. 
After reversal, all items on a scale load 
that scale factor with the same sign. 
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APPENDIX C 

INTERCORRELATION MATRIX OF MAJOR 
VARIABLES, GROUP B 
N=427 


Key 


No. 

Descr. 

1 

thru 

25 

symptom items 
by number 

26 

16PF B 

27 

sex 

28 

education 

29 

age 

30 

IBT 1 

thru 

thru 

39 

IBT 10 

40 

symptom total 

41 

16PF A 

42 

16PF C 

thru 

thru 

55 

16PF Q4 

56 

IBT total 
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12 3 4 

2 0.42 4 

3 0.386 0.395 

4 0.926 0.579 0.474 

5 0.224 0.201 0.142 0.218 

6 0.300 0.365 0.415 0.394 
/ 0.312 0.33/ 0.379 0.426 

8 0.468 0.373 0.373 0.471 

9 0.333 0.408 0.400 0.486 

10 0.492 0.424 0.328 0.478 

11 0.324 0-390 0.330 0.386 

12 0.403 0.437 0.397 0.508 

13 0.466 0.36L 0.391 0.500 

14 0.312 0.360 0.330 0.472 

15 0.446 0.419 0.301 0.488 
15 0.385 0.296 0.499 0.422 

17 0.333 0.379 0.342 0.458 

18 0.297 0.472 0.289 0.435 

19 0.284 0.263 0.276 0.345 

20 0.216 0.344 0.353 0.409 

21 0.336 0.519 0.407 0.547 

22 0.263 0.341 0.392 0.445 

23 0.406 0.359 0.378 0.441 

24 U- 238 0.334 0.383 0.424 

25 0.298 0.329 0.359 0.419 

26 0.154 0.077 0.097 0.095- 
2 7-0.OriO-u. 156-0.0 7 6-0. 14 8- 
28-0.013-0.001 0.007-0.053- 
2 9-0.0 5 1-0.036-0.04 8-0.124- 

30 0.348 G- 300 0.304 0.313 

31 0.315 0.271 0.298 0.338 

32 0.096 0.125 0.132 0.132 

33 0.350 0.281 0.201 0.276 

34 0.139 0.254 0.1j>7 0.192 

35 0.521 0.396 0.337 0.432 

36 0.227 0-305 0.269 0.275 

37 0.048-0.053 0.080-0.014- 

38 0.292 0.338 0.273 0.332 
39-0.038-6.054-0.015-0.047- 
40 0.594 0.622 0.6u2 0.731 
41-0.119-0.090-0.202-0.126- 
4 2-0.24 7-u. 310-0.234-0.296- 

43- 0.007 0.001-0.062-0.000 

44- 0. 104-0. 116-0.204-0. 155 

45- 0.061-0.167-0.206-0.214- 

46- 0.272-0.224-0.325-0.265- 

47 0.083-0.019 0.024 0.Old- 

48 0.245 0.178 0.160 0.216 

49 0.0o 7 0. 105 0. 139 0.090 
50-0.051-0.134-0.175-0.156- 
3l 0.374 0.372 0.342 0.405 

52- 0.084-u-022-0.013-0.043 

53- 0.029 0.007 0.060 0.052 

54- 0.250-0.251-0.215-0.23fa- 

55 0.396 u•312 0.341 0.379 

56 0.454 0.427 0.394 0.440 


5 6 7 8 9 


0. 1 89 

0. 14 4 0.44 4 
0.281 0.344 0.392 
0.243 0.460 0.512 0.472 
0.230 0.398 0.396 0.465 0.431 
0.243 0.300 0.322 0.315 0.384 
0.282 0.420 0.495 0.516 0.496 
0.300 0.385 0.397 0.488 0.383 
0.261 0.284 0.296 0.429 0.423 
0.175 0.346 0.381 0.420 0.449 
0.072 0.466 0.335 0.353 0.388 
0.159 0.441 0.3/7 0.478 0.497 
0.160 0.342 0.283 0.410 0.488 
0.164 0.286 0.321 0.351 0.369 
0.152 0.345 0.332 0.351 0.461 
0.196 0.395 0.380 0.416 0.4b4 
0.328 0.414 0.365 0.430 0.449 
0.488 0.377 0.322 0.402 0.360 
0.173 0.310 0.201 0.271 0.285 
0.269 0.417 0.368 0.379 0.478 
0.001 0.137-0.010 0.056 0.079 
0.216-0.128-0.074-0.138-0.135 
0.0/9 0.133 0.059 0.064 0.196 
0.144-0.080-0.137-0.122-0.156 
0.095 0.306 0.246 0-262 0.283 
0.304 0.269 0.267 0.328 0.295 
0.237 0. 182 0.U64 0.138 0. 119 
0.301 0.287 0.205 0.200 0.219 
0.084 0.174 0.134 0.114 0.156 
0.256 0.393 0.353 0.461 0.357 
0.142 0.288 0.255 0.1/4 0.231 
0.012 0.075-0.014 0.022-0.L04* 
0.193 0.354 0.312 0.354 0.351 
0.044-0.031-0.103-0.081-0.062 
0.394 0.626 0.593 0.673 0.698 
0.079-0-138-0.140-U.097-0.151 
0.270-0.345-0.288-0.337-0.358 
0.2 e>4-0 .046 0.025 0.029 0.001 
0.020-0.252-0.137-0.142-0.219 
0.138-0.166-0.147-0.133-0.170 
0.067-0.325-0.251-0.180-0.245 
0.114 0.044-0.010 0.017-0.019 
0.230 0.245 0.242 0.221 0.231 
0.063 0.118 0.168 0.089 0.177 
0.08 9-0.0/6-0. i. 94-0.062-0-091 
0.237 0.419 0.363 0.421 0.403 
0.02B-0.017-0.000-0.064-0.065 
0.026 0.022 0.023-0.033 0.032 
0.316-0.183-0.207-0.226-0.298 
0.404 0.356 0.361 0.344 0.385 
0.296 0.451 0.342 0.391 0.368 
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APPENDIX D 


SYMPTOM MEASURE 
USED IN THE STUDY 
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Everyone has his good days and bad days, and all of us have ascertain 
amount of unpleasantness in our lives. This brief index measures the 
extent to which you react to your problems in certain ways. 


You may feel free to be as honest with yourself as possible in your 
answers, since the results wiil not be looked at for any^’individual. 
The purpose of this index is to investigate any relationship of these 
feelings and reactions statistically to various scores on the other 
tests you are taking. The scoring and computations are all done on 
a computer. Your cooperation will contribute greatly to the research 
being done. 


For this index, you will use the same answer sheet provided for the 
IBT, except you will use the bottom part this time according to the 
numbers of the items. For each statement there are five possible 
answers: 

1 = almost never 

2 = occasionally 

3 = some of the time 

4 = much of the time 

5 - most of the time 


Your answer for each item should be the one that most accurately des¬ 
cribes you. For example, on the first item, if you almost never 
worry, you would mark # 1 ; but if you have a great tendency to worry 
about various things, answer /M or /VS would be more accurate. 


145. 

146. 

147. 
- 148. 

149. 


I worry. 

I feel unhappy. 

I feel inadequate and inefficient. 
I become depressed and blue. 

I get angry easily. 


150. I would like to be different from the way I am. 

151. I have guilty feelings. 

152. I live with a lot of anxiety. 

153. I don't like myself very much. 

154. I tend to be tense and nervous. 


155. I have trouble doing things I know I .need to do. 

156. My emotions give me trouble. 

157. Frustrations "bug" me. 

158. I tend to be pessimistic. 

159. My nerves bother me. 


160. I don’t have enough confidence. 

161. My problems seem to keep repeating themselves. 

162. Life is not enjoyable or fun. 

163. I often feel bad physical1y. 

164. I don't feel close to older people. 


165. Life seems dreary and difficult. 

166 - x loci a let oi rese;um>.nL. 

167. I become upset easily. 

168. 1 find it hard to get interested in things. 

169. I feel like giving up. 
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APPENDIX E 


RESEARCH FORM OF THE 1BT 
USED IN THE STUDY 




89 


I B T 

INSTRUCTIONS 

This is an inventory of the way you believe and feel about 
various things. There are a number of statements with 
which you will tend to agree or disagree. You will be 
given an answer sheet with spaces to mark one of five 
possible answers to each item. For each statement, you 
should mark your answer sheet as follows, according to 
your own reaction to the item: 

mark #1 if you STRONGLY DISAGREE 
mark #2 if you MODERATELY DISAGREE 
mark #3 if you NEITHER AGREE NOR DISAGREE 
mark #4 if you MODERATELY AGREE 
mark #5 if you STRONGLY AGREE 

It is not necessary to think over any item very long. Mark 
your answer quickly and go on to the next statement. 

Ee sure to mark how you actually feel about the statement, 
not how you think you should feel. 

Try to avoid the neutral or "3” response as much as possible. 
Select this answer only if you really cannot decide whether 
you tend to agree or disagree with a statement. 

Before you start, be sure to print your name, sex, and age 
at the top of the answer sheet wnerc indicated. In die 
soace for ’’grade", place the number of the highest school 
grade completed. If you have had college, one year would 
be 13, four years would be 16, etc. 

Your answer sheet is a standard form which is scored by a 
computer, so you may feel free to be as honest in your 
answers as possible. To avoid misreading by the computer, 
be sure your marks are heavy and within the dotted lines. 
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!• It is important to me that others approve of me. 

2. I hate to fail at anything. 

3. People who do wrong deserve what they get. 

4. I usually accept what happens philosophically. 

5. If a person wants to, he can be happy under almost any 

circumstances. 

6. I have a fear of some things that often bothers me. 

7. I usually put off important decisions. 

8. Everyone needs someone he can depend on for help and advice. 

9. "A zebra cannot change his stripes". 

10. There is a right way to do everything. 

11. I like the respect of others, but I don't have to have it. 

12. I avoid things I cannot do well. 

15. Too many evil persons escape the punishment they deserve. 

14. Frustrations don't upset me. 

15. People are disturbed not by situations but by the view they 

take of them. 

16. I feel little anxiety over unexpected dangers or future events. 

17. I try to go ahead and get irksome tasks behind me when they 

come up. 

IS. I try to consult an authority on important decisions. 

13. It is almost impossible to overcome tne influences of the past. 

20. There is no perfect solution to anything. 

21. I want everyone to like me. 

22. I don't mind competing in activities where others are better 

than I. 

23. Those who do wrong deserve to be blamed. 

24. Things should be different from the way they are. 

25. I cause my own moods. 

26. I often can't get my mind off some concern. 

27. I avoid facing my problems. 

28. People need a source of strength outside themselves. 

29. Just because something once strongly affects your life doesn't 

mean it need do so in the future. 

30. There is seldom an easy way out of life's difficulties. 

51. I can like myself even when many others don't. 

32. I like to succeed at something but I don't feel I have to. 

33. Immorality should be strongly punished. 

34. ' I often get disturbed over situations I don't like. 
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jo . 

36. 


57. 

V r> 

O • 

39. 

40. 

* 1 

*-t ^ . 

42. 
4 5. 
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49. 

50. 


People who & re miserable have usually made themselves that way 

If I can't keep something from happening, I don't worry 
about it. 

I usually maj-.e decisions as promptly as I can. 

u.ere are certain people that 1 depend on greatly. 

:eople overvalue the influence of the past. 

Some problems will always be with us. 

If others dislike me, that's their problem, not mine. 

It is i.ighly important to me to be successful in evervthinr 
I do. b 

I seldom blame people for their wrongdoings. 

I usually accept things the way they are, even if I don't 
like them. 

A person won't stay angry or blue long unless he keeps himsel: 
that way. 

I can't stand to take chances. 

Life is too short to spend it doing unpleasant tasks. 

I like to stand on my own two feet. 

If I had had different experiences I could be more like I want 
to be. 

Every problem has a correct solution. 



55 . 

r~ A 

On , 
Jj , 

56 . 

57 . 
5S. 
59 . 


I find it hard to go against what others think. 

I enjoy activities for their own sake, no matter how good 1 
am at them. 


The fear of punishment helps people be good. 

If tilings annoy me, I just ignore them. 

The more -problems a person has, the less happy he will be. 

1 am selaaii; anxious over the future. 

I seldom put things off. 

I am the only one who can realIv understand and face mv rrobi 

V p P J 


ems . • 


I a-'Idom think of past experiences as affecting me now. 
We live in a world of chance ana probability. 


61. Although I like approval, it's not a real need for me. 

62. It bothers me \hen others are better than I am at something. 

65. Everyone is basical ±y good. 

64. i do what I can to get what I want and then don't worry about 

65. nothing is upsetting in itself-- only in the way you interpret it. 

66. I worry a lot about certain things in the future. 

67. It is difficult for me to do unpleasant chores. 
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68. I dislike for others to make my decisions for me. 

69. We are slaves to our personal histories. 

70. Tnere is seldom an ideal solution to anything. 


71. I often worry about how much people approve of and accept me. 

72. It upsets me to make mistakes. 

75. It's unfair that "the rain falls on both the just and the unjust". 

74. I am fairly easygoing about life. 

75. More people should face up to the unpleasantness of life. 

76. Sometimes I can't get a fear off my mind. 

77. A life of ease is seldom very rewarding. 

78. I find it easy to seek advice. 

79. Once something strongly affects your life, it always will. 

80. It is better to look for a practical solution than a perfect one. 


81. 
82. 
85 . 
84. 
85 . 
So. 
87. 

. 

So. 
90. 


I have considerable concern with what people are feeling about me. 
I often become quite annoyed over little things. 

I usually give someone who has wronged me a second chance. 


I dislike responsibility. 


There is never any -'eason to remain 
I hardly ever think of such things 
People are happiest when they have 
overcome. 

I dislike having to depend on other 
People never change basically. 

I feel I must handle things in the 


sorrowful for very Ion 

LiS LiCdtjt Wa c* L O.. * -i. C . 

challenges and problems 
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94. 

95. 

96. 

97. 
o o. 

99 . 


It is annoying but not upsetting to be criticized. 

I'm not afraid to do things which I cannot do well. 

Xo one i-. evil, even though his deeds may be. 

I seldom become upset over the mistakes of others. 

Man makes his own hell within himself. 

I often find myself planning what I would do in different dan¬ 
gerous situations. 

If something is necessary, i ao it even if it is unpleasant. 
I've learned r.ot to expect someone else to be very concerned 
about my welfare. 

I don't look upon the past with any regrets. 

There is no such thing as an ideal set of circumstances. 



